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NATIONAL FOREWORD 

This Indian Standard (Parts) which is identical with ISO 5725-5:1 998 'Accuracy (trueness and precision) 
of measurement methods and results — Part 5: Alternative methods for the determination of the precision 
of a standard measurement method' issued by the International Organization for Standardization (ISO) 
was adopted by the Bureau of Indian Standards on the recommendations of the Engineering Metrology 
Sectional Committee and approval of the Basic and Production Engineering Division Council. 

This standard provides detailed description of alternatives to the basic method for determining the 
repeatability and reproducibility standard deviations of a standard measurement method, namely, the 
split-level design and a design for heterogeneous materials. It also describes the use of robust methods 
for analyzing the results of precision experiments without using outer tests to exclude data from the 
calculations, and in particular, the detailed use of one such method. 

The text of the ISO Standard has been approved as suitable for publication as an Indian Standard without 
deviations. In this adopted standard certain conventions are, however, not identical to those used in 
Indian Standards. Attention is particularly drawn to the followinq: 

a) Wherever the words International Standard' appear referring to this standard, they should 
be read as 'Indian Standard', 

b) Comma (,) has been used as a decimal marker in the International Standards while in Indian 
Standards, the current practice is to use a point (.) as the decimal marker. 

In the adopted standard, reference appears to certain International Standards for which Indian Standards 
also exist. The corresponding Indian Standards which are to be substituted in their place are listed below 
along with their degree of equivalence for the editions indicated: 



International Standard 



Corresponding Indian Standard 



Degree of 
Equivalence 



ISO 5725-1:1994 Accuracy 
{trueness and precision) of 
measurement methods and 
results — Part 1 : General 
principles and dimensions 

ISO 5725-2:1994 Accuracy 
(trueness and precision) of 
measurement methods and 
results — Part 2 : Basic method for 
the determination of repeatability 
and reproducibility of a standard 
measurement method 



IS 1 5393 (Part 1 ) : 2003 Accuracy (trueness 
and precision) of measurement methods 
and results:Part 1 General principles and 
dimensions 

tSI 5393 (Part 2) : 2003 Accuracy (trueness 
and precision) of measurement methods 
and results:Part 2 Basic method for the 
determination of repeatability and 
reproducibility of a standard measurement 
method 



Identical 



do 



This standard (Part 5) covers the alternative methods for the determination of the precision of a standard 
measurement method. The other five parts of the standard are listed below: 



IS No. 



Title 



IS 15393 (Part 1) : 2003/ Accuracy (trueness and precision) of measurement methods and results: 
ISO 5725-1 :1 994 Part 1 General principles and definitions 

IS 15393 (Part 2) : 2003/ Accuracy (trueness and precision) of measurement methods and results: 
ISO 5725-2: 1 994 Part 2 Basic method for the determination of repeatability and reproducibility of 

a standard measurement method 
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Indian Standard 

ACCURACY (TRUENESS AND PRECISION) OF 
MEASUREMENT METHODS AND RESULTS 

PART 5 ALTERNATIVE METHODS FOR THE DETERMINATION OF THE 
PRECISION OF A STANDARD MEASUREMENT METHOD 

1 Scope 

This part of ISO 5725 

— provides detailed descriptions of alternatives to the basic method for determining the repeatability and 
reproducibility standard deviations of a standard measurement method, namely the split-level design and a 
design for heterogeneous materials; 

— describes the use of robust methods for analysing the results of precision experiments v\/ithout using outlier 
tests to exclude data from the calculations, and in particular, the detailed use of one such method. 

This part of ISO 5725 complements ISO 5725-2 by providing alternative designs that may be of more value in some 
situations than the basic design given in ISO 5725-2, and by providing a robust method of analysis that gives 
estimates of the repeatability and reproducibility standard deviations that are less dependent on the data analyst's 
judgement than those given by the methods described in ISO 5725-2. 



2 Normative references 

The following standards contain provisions which, through reference in this text, constitute provisions of this part of 
ISO 5725. At the time of publication, the editions indicated were valid. All standards are subject to revision, and 
parties to agreements based on this part of ISO 5725 are encouraged to investigate the possibility of applying the 
most recent editions of the standards indicated beiow. f\4embers of lEC and ISO maintain registers of currently valid 
International Standards. 

ISO 3534-1 :1993, Statistics — Vocabulary and symbols — Part i: Probability and general statistical terms. 

ISO 3534-3:1985, Statistics — Vocabulary and symbols — Part 3: Design of experiments. 

ISO 5725-1:1994, Accuracy (trueness and precision) of measurement methods and results — Part 1: General 
principles and definitions. 

ISO 5725-2:1994, Accuracy (trueness and precision) of measurement methods and results — Part 2: Basic method 
for the determination of repeatability and reproducibility of a standard measurement method. 
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3 Definitions 

For the purposes of this part of ISO 5725, the definitions given in ISO 3534-1 and in ISO 5725-1 apply. 

The symbols used in ISO 5725 are given in annex A. 



4 Split-level design 

4.1 Applications of the split-level design 

4.1.1 The uniform level design described in ISO 5725-2 requires two or more identical samples of a material to be 
tested in each participating laboratory and at each level of the experiment. With this design there is a risk that an 
operator may allow the result of a measurement on one sample to influence the result of a subsequent 
measurement on another sample of the same material. If this happens, the results of the precision experiment will 
be distorted: estimates of the repeatability standard deviation o> will be decreased and estimates of the between- 
laboratory standard deviation a\_ will be increased. In the split-level design, each participating laboratory is provided 
with a sample of each of two similar materials, at each level of the experiment, and the operators are told that the 
samples are not identical, but they are not told by how much the materials differ. The split-level design thus provides 
a method of determining the repeatability and reproducibility standard deviations of a standard measurement 
method in a way that reduces the risk that a test result obtained on one sample will influence a test result on 
another sample in the experiment. 

4.1.2 The data obtained at a level of a split-level experiment may be used to draw a graph in which the data for 
one material are plotted against the data for the other, similar, material. An example is given in figure 1. Such 
graphs can help identify those laboratories that have the largest biases relative to the other laboratories. This is 
useful when it is possible to investigate the causes of the largest laboratory biases with the aim of taking corrective 
action. 

4.1.3 It is common for the repeatability and reproducibility standard deviations of a measurement method to 
depend on the level of the material. For example, when the test result is the proportion of an element obtained by 
chemical analysis, the repeatability and reproducibility standard deviations usually increase as the proportion of the 
element increases. It is necessary, for a split-level experiment, that the two similar materials used at a level of the 
experiment are so similar that they can be expected to give the same repeatability and reproducibility standard 
deviations. For the purposes of the split-level design, it is acceptable if the two materials used for a level of the 
experiment give almost the same level of measurement results, and nothing is to be gained by arranging that they 
differ substantially. 

In many chemical analysis methods, the matrix containing the constituent of interest can influence the precision, so 
for a split-level experiment two materials with similar matrices are required at each level of the experiment. A 
sufficiently similar material can sometimes be prepared by spiking a material with a small addition of the constituent 
of interest. When the material is a natural or manufactured product, it can be difficult to find two products that are 
sufficiently similar for the purposes of a split-level experiment: a possible solution may be to use two batches of the 
same product. It should be remembered that the object of choosing the materials for the split-level design is to 
provide the operators with samples that they do not expect to be identical. 

4.2 Layout of the split-level design 

4.2.1 The layout of the split-level design is shown in table 1 . 

The p participating laboratories each test two samples at q levels. 

The two samples within a level are denoted a and b, where a represents a sample of one material, and b represents 
a sample of the other, similar, material. 
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4.2.2 The data from a split-level experiment are represented by: 

yijk 

where 

subscript /' represents the laboratory = 1, 2, ..., p); 

subscript; represents the level 0=1.2 <?); 

subscript k represents the sample (lc = aor b). 

4.3 Organization of a split-level experiment 

4.3.1 Follow the guidance given in clause 6 of ISO 5725-1:1994 when planning a split-level experiment. 

Subclause 6.3 of ISO 5725-1:1994 contains a number of formulae (involving a quantity denoted generally by A) that 
are used to help decide how many laboratories to include in the experiment. The corresponding formulae for the 
split-level experiment are set out below. 

NOTE — These formulae have been derived by the method described in NOTE 24 of ISO 5725-1:1994. 

To assess the uncertainties of the estimates of the repeatability and reproducibility standard deviations, calculate 
the following quantities. 

For repeatability 

A, =1,96^l/[2(;7-l)] (1) 

For reproducibility 

Ar - 1,96j|[l +2(y2 - 1)]^ + ^y[8y'{p - 1)] (2) 

with 7= a^a^. 

If the number n of replicates is taken as two in equations (9) and (10) of ISO 5725-1:1994, then it can be seen that 
equations (9) and (10) of ISO 5725-1:1994 are the same as equations (1) and (2) above, except that sometimes 
p - 1 appears here in place of p in ISO 5725-1:1994. This is a small difference, so table 1 and figures B.1 and B.2 of 
ISO 5725-1:1994 may be used to assess the uncertainty of the estimates of the repeatability and reproducibility 
standard deviations in a split-level experiment. 

To assess the uncertainty of the estimate of the bias of the measurement method in a split-level experiment, 
calculate the quantity A as defined by equation (13) of ISO 5725-1:1994 with n = 2 (or use table 2 of 
ISO 5725-1:1994), and use this quantity as described in ISO 5725-1. 

To assess the uncertainty of the estimate of a laboratory bias in a split-level experiment, calculate the quantity A^^ as 
defined by equation (16) of ISO 5725-1:1994 with n = 2. Because the number of replicates in a split-level experiment 
is, in effect, this number of two, it is not possible to reduce the uncertainty of the estimate of laboratory bias by 
increasing the number of replicates. (If it is necessary to reduce this uncertainty, the uniform-level design should be 
used instead.) 

4.3.2 Follow the guidance given in clauses 5 and 6 of ISO 5725-2:1994 with regard to the details of the 
organization of a split-level experiment. The number of replicates, n in ISO 5725-2, may be taken to be the number 
of split-levels in a split-level design, i.e. two. 

The a samples should be allocated to the participants at random, and the b samples should also be allocated to the 
participants at random and in a separate randomization operation. 




stated there that for estimating the accuracy {trueness and precision) of a measurement method, it is useful to 
assume that every measurement result is the sum of three components: 



where, for the particular material tested. 



(3) 



my represents the general average (expectation) at a particular level j = 1 , ..., q\ 

B-j represents the laboratory component of bias under repeatability conditions in a particular laboratory 
i=^ pat a particular level y = 1 q; 

e,.i^ represents the random error of test result /; = 1 n , obtained in laboratory i at level y, under repeatability 



conditions. 



4.4.2 For a split-level experiment, this model becomes: 



(4) 



This differs from equation (3) in 4.4.1 in only one feature: the subscript k in niji^ implies that according to equation (4) the 
general average may now depend on the material a or fe (k = 1 or 2) within the level y. 

The lack of a subscript k in fi^ implies that it is assumed that the bias associated with a laboratory i does not depend 
on the material aor b within a level. This is why it is important that the two materials should be similar. 



4.4.3 Define the cell averages as: 

yij = ^ija + y.jb) < 2 

and the cell differences as: 



(5) 



(6) 
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4.4.4 The general average for a level; of a split-level experiment may be defined as: 

"^j = ('^Ja + "^jb^ ' 2 (7) 

4.5 Statistical analysis of the data from a split-level experiment 

4.5.1 Assemble the data into a table as shown in table 1 . Each combination of a laboratory and a level gives a 
"cell" in this table, containing two items of data, y,^^, and >'y^. 

Calculate the cell differences D,-^ and enter them into a table as shown in table 2. The method of analysis requires 
each difference to be calculated in the same sense 

a-b 
and the sign of the difference to be retained. 
Calculate the cell averages y^^ and enter them into a table as shown in table 3. 

4.5.2 If a cell in table 1 does not contain two test results (for example, because samples have been spoilt, or data 
have been excluded following the application of the outlier tests described later) then the corresponding cells in 
tables 2 and 3 both remain empty. 

4.5.3 For each level j of the experiment, calculate the average Dj and standard deviation Sj^j of the differences in 
column) of table 2: 

Here, Z represents summation over the laboratories ( = 1,2 p. 

If there are empty cells in table 2, p is now the number of cells in column j of table 2 containing data and the 
summation is performed over non-empty cells. 

4.5.4 For each level j of the experiment, calculate the average y^ and standard deviation Syj of the averages in 
column; of table 3, using: 

Here, S represents summation over the laboratories i = 1, 2, .... p. 

If there are empty cells in table 3, p is now the number of cells in column ; of table 3 containing data and the 
summation is performed over non-empty cells. 

4.5.5 Use tables 2 and 3 and the statistics calculated in 4.5.3 and 4.5.4 to examine the data for consistency and 
outliers, as described in 4.6. If data are rejected, recalculate the statistics. 
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4.5.6 Calculate the repeatability standard deviation s^j and the reproducibility standard deviation s^j from: 



4; =4^* 



?/2 



(12) 
(13) 



4.5.7 Investigate whether j; and 5^ depend on the average y , and, if so, determine the functional relationships, 
using the methods described in subclause 7.5 of ISO 5725-2:1994. 



Table 2 — Recommended form for tabulation of cell differences for the split-level design 



Laboratory 


Level 


1 


2 




J 




1 














1 
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Table 3 — Recommended form for tabulation of cellaverages for the split-level design 



Laboratory 


Level 


1 


2 




; 




q 














1 














2 














1 














1 


1 












1 




1 




P 









4.6 Scrutiny of the data for consistency and outliers 

4.6.1 Examine the data for consistency using the h statistics, described in subclause 7.3.1 of ISO 5725-2:1994. 

To check the consistency of the cell differences, calculate the h statistics as: 



To check the consistency of the cell averages, calculate the h statistics as: 
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(15) 



To show up inconsistent laboratories, plot both sets of these statistics in the order of the levels, but grouped by 
laboratory, as shown in figures 2 and 3. The interpretation of these graphs is discussed fully in subclause 7,3.1 of 
ISO 5725-2:1994. If a laboratory is achieving generally worse repeatability than the others, then it will show up as 
having an unusually large nunnber of large h statistics in the graph derived from the cell differences. If a laboratory is 
achieving results that are generally biased, then it will show up as having h statistics mostly in one direction on the 
graph derived from the cell averages. In either case, the laboratory should be asked to investigate and report their 
findings back to the organizer of the experiment. 



4.6.2 Examine the data for stragglers 
180 5725-2:1994. 



and outliers using Grubbs' tests, described in subclause 7.3.4 of 



To test for stragglers andjoutliers in the cell differences, apply Grubbs' tests to the values in each column of table 2 
in turn. 

To test for stragglers and outliers in the cell averages, apply Grubbs' tests to the values in each column of table 3 in 
turn. 

The interpretation of these tests is discussed fully in subclause 7.3.2 of ISO 5725-2:1994. They are used to identify 
results that are so inconsistent with the remainder of the data reported in the experiment that their inclusion in the 
calculation of the repeatability and reproducibility standard deviations would affect the values of these statistics 
substantially. Usually, data shown to be outliers are excluded from the calculations, and data shown to be stragglers 
are included, unless there is a good reason for doing otherwise. If the tests show that a value in one of tables 2 or 3 
is to be excluded from the calculation of the repeatability and reproducibility standard deviations, then the 
corresponding value in the other of these tables should also be excluded from the calculation. 

4.7 Reporting the results of a split-level experiment 

4.7.1 Advice is given in subciausLe 7.7 of ISO 5725-2:1994 on: 

— reporting the results of the statistical analysis to the panel; 

— decisions to be made by the panel; and 

— the preparation of a full report. 

4.7.2 Recommendations on the form of a published statement of the repeatability and reproducibility standard 
deviations of a standard measurement method are given in subclause 7.1 of ISO 5725-1:1994. 

4.8 Example 1 : A split-level experiment — Determination of protein 

4.8.1 Table 4 contains the data from an experiment t^l which involved the determination by combustion of the 
content of protein in feeds. There were nine participating laboratories, and the experiment contained 14 levels. 
Within each level, two feeds were used having similar mass fraction of protein in feed. 

4.8.2 Tables 5 and 6 show the cell averages and differences, calculated as described in clause 4.5.1, for just 
Level 14 (7 = 14) of the experiment. 

Using equations (8) and (9) in 4.5.3, the differences in table 5 give: 

Di4 = 8.34 % 

5^14 = 0,436 1 % 
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and applying equations (10) and (11) in 4.5.4 to the averages in table 6 gives: 

)'14 = 85,46% 

sy^^ = 0,453 4 % 
so the repeatability and reproducibility standard deviations are, using equations (12) and (13) in 4.5.6: 

.^14 = 0,31 % 

i«i4 = 0,50 % 
Table 7 gives the results of the calculations for the other levels. 

4.8.3 Figure 1 shows the results for samples a from table 4 plotted against the corresponding results for samples 
b, for Level 14, in a "Youden plot". Laboratory 5 gives a point in the bottom left-hand corner of the graph, and 
Laboratory 1 gives a point in the top right-hand corner: this indicates that the data from Laboratory 5 have a 
consistent negative bias over samples a and h, and that the data from Laboratory 1 have a consistent positive bias 
over the two samples, it is common to find this sort ot pattern when plotting the data from a split-level design as in 
figure 1 . The figure also shows that the results for Laboratory 4 are unusual, as the point for this laboratory is some 
distance from the line of equality for the two samples. The other laboratories form a group in the middle of the plot. 
This figure thus provides a case for investigating the causes of the biases at the three laboratories. 

NOTE — For further Information on the interpretation of "Youden plots", see references [7] and [8]. 

4.8.4 The values of the h statistics, calculated as described in 4.6.1 , are shown in tables 5 and 6, for only Level 14. 
The values for all levels are plotted in figures 2 and 3. 

In figure 3, the h statistics for cell averages show that Laboratory 5 gave negative h statistics at all levels, indicating 
a consistent negative bias in their data. In the same figure. Laboratories 8 and 9 gave h statistics that are nearly all 
positive, indicating consistent positive biases in their data (but smaller than the negative bias in Laboratory 5). Also, 
the h statistics for Laboratories 1, 2 and 6 indicate a bias that changes with level in each of these laboratories. Such 
interactions between the laboratories and the levels may provide clues as to the causes of the laboratory biases. 

Figure 2 does not reveal any noteworthy pattern. 

4.8.5 Values of the Grubbs' statistics are given in table 8. These tests again indicate that the data from 
Laboratory 5 are suspect. 

4.8.6 At this point in the analysis, the statistical expert should initiate an investigation at Laboratory 5 of the 
possible causes of the suspect data, before proceeding with the analysis of the data. If the cause cannot be 
identified, there is a case in this instance for excluding alt data from Laboratory 5 from the calculation of the 
repeatability and reproducibility standard deviations. The analysis would then continue with an investigation of 
possible functional relationships between the repeatability and reproducibility standard deviations and the general 
average. This does not raise any issues that have not already been covered in ISO 5725-2, so it will not be 
considered here. 
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Table 4 — Example 1: Determination of mass fraction of protein in feed, expressed as a percentage 



Laboratory 


Level 


1 


2 


3 


4 


5 


a 


b 


a 


b 


a 


b 


a 


b 


a 


b 


1 


11,11 


10,34 


10,91 


9,81 


13,74 


13,48 


13,79 


13,00 


15,89 


15,26 


2 


11,12 


9,94 


11,38 


10,31 


14,00 


13,12 


13,44 


13,06 


15,69 


15,10 


3 


11,26 


10,46 


10,95 


10,51 


13,38 


12,70 


13,54 


13,18 


15,83 


15,73 


4 


11,07 


10,41 


11,66 


9,95 


13,01 


13,16 


13,58 


12,88 


15,08 


15,63 


5 


10,69 


10,31 


10,98 


10,13 


13,24 


13,33 


13,32 


12,59 


15,02 


14,90 


6 


11,73 


11,01 


12,31 


10,92 


14,01 


13,66 


14,04 


13,64 


16,43 


15,94 


7 


11,13 


10,36 


11,38 


10,44 


12,94 


12,44 


13,63 


13,06 


15.75 


15,56 


8 


11,21 


10,51 


11,32 


10,84 


13,09 


13,76 


13,85 : 


13,49 


15,98 


15,89 


9 


11,80 


11,21 


11,35 


9,88 


13,85 


14,46 


13,96 


13,77 


16.51 


15,72 


Laboratory 


Level 


6 


7 


8 


9 


10 


a 


b 


a 


b 


a 


b 


a 


b 


a 


b 


1 


20,14 


19,78 


20,33 


20,06 


46,45 


44,42 


52,05 


49,40 


65,84 


59,14 


2 


19,25 


20,25 


20,36 


19,94 


46,69 


44,62 


51,94 


48,81 


66,31 


59,19 


3 


20,48 


19,86 


20,56 


20,11 


46,90 


44,56 


52,18 


48,90 


66,06 


58,52 


4 


21,54 


20,06 


20,64 


20,46 


47,13 


45,29 


51 ,73 


48,56 


65,93 


58,93 


5 


19,90 


19,66 


20,56 


19,24 


45,83 


43,73 


50,84 


47,91 


64.19 


57,94 


6 


20,31 


20,27 


20,85 


20,63 


46,86 


43,96 


52,18 


49,03 


65.73 


58,77 


7 


20,00 


20,56 


20,25 


20,19 


46,25 


44,31 


52,25 


49,44 


66.06 


59,19 


8 


20,43 


20,69 


20,85 


20,27 


47,11 


44,40 


52,44 


48,81 


65,66 


59.38 


9 


20,64 


21,01 


20,78 


20,89 


47,09 


45,15 


52,19 


48,46 


66,33 


59,47 


Laboratory 


Level 


11 


12 


13 


14 




a 


h 


a 


b 


a 


b 


a 


b 






1 


84,16 


80,86 


85,38 


81,71 


a7,64 


88,23 


90,24 


82,10 






2 


84,50 


81,06 


85,56 


82,44 


88,81 


88,38 


89,88 


81,44 






3 


82,26 


79,43 


85,26 


82,15 


88,58 


88,12 


89,48 


81,67 






4 


84,39 


80,08 


85,20 


81,76 


88,47 


87,98 


90,04 


80,73 






5 


81,71 


79,01 


83,58 


79,74 


86,43 


86,19 


88,59 


80,46 






6 


82,85 


81,16 


84,44 


80,90 


87,78 


86,89 


89,40 


80,88 






7 


86,25 


81,00 


84,88 


81,44 


88,06 


88,00 


89,31 


81,38 






8 


84,59 


81,16 


84,96 


81,71 


88,50 


87,9t 


89,94 


81,56 






9 


83,05 


80,93 


84,73 


81,94 


88,24 


88,05 


89,75 


81,35 
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Table 5 — Example 1 : Cell differences 
for Level 14 



Table 6 — Example 1 : Cell averages 
for Level 14 



Laboratory 


Cell 
difference 

% 


h 
Statistic 


1 


8,14 


- 0,459 


2 


8,44 


0,229 


3 


7.81 


-1,215 


4 


9,31 


2,224 


5 


8,13 


-0,482 


6 


8,52 


0,413 


7 


7,93 


- 0,940 


8 


8,38 


0,092 


9 


8,40 


0,138 



Laboratory 


Cell 
difference 

% 


h 
Statistic 


1 


86,170 


1,576 


2 


85,660 


0.451 


3 


85,575 


0.263 


4 


85,385 


-0,156 


5 


84,525 


-2,052 


6 


85,140 


- 0,696 


7 


85,345 


-0,244 


8 


85,750 


0,649 


9 


85,550 


0,208 



Table 7 — Example 1 : Values of averages, average differences, and standard deviations calculated 

from the data for all 14 levels in table 4 



Level 

J 


Number of 
laboratories 


Genera) 
average 


Average 
difference 

Dj% 


s,,% 


Standard ( 


leviatlons 


S^j% 


1 


9 


10.87 


0,73 


0,35 


0,21 


0,15 


0.36 


2 


9 


10,84 


1,05 


0.36 


0,43 


0,30 


0.42 


3 


9 


13.41 


0,13 


0.44 


0,55 


0,39 


0.52 


4 


9 


13,43 


0,50 


0.30 


0,21 


0,15 


0.32 


5 


9 


15.66 


0,27 


0.39 


0,40 


0,29 


0.44 


6 


9 


20,27 


0.06 


0,40 


0,73 


0,52 


0.54 


7 


9 


20,39 


0.38 


0,30 


0.41 


0,29 


0.37 


8 


9 


45,60 


2.21 


0,44 


0.37 


0,26 


0,47 


9 


9 


50,40 


3.16 


0,44 


0.35 


0,25 


0,47 


10 


9 


62,37 


6,84 


0,53 


0,40 


0,28 


0,57 


11 


9 


82,14 


3,23 


1,01 


1,08 


0.77 


1,15 


12 


9 


83.17 ' 


3,45 


0,74 


0,46 


0.33 


0,77 


13 


9 


87,91 


0,30 


0,69 


0,41 


0.29 


0,72 


14 


9 


85.46 


8,34 


0,45 


0,44 


0,31 


0,50 
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Table 8 — Example 1 : Values of Grubbs' statistics 



Grubbs' statistics tor differences 


Level 


One smallest 


Two smallest 


Two largest 


One largest 


1 


1,653 


0,5081 


0,3139 


2,125 


2 


1,418 


0,3945 


0,4738 


1,535 


3 


1,462 


0,3628 


0,5323 


1,379 


4 


1,490 


0,5841 


0,4771 


1,414 


5 


2,033 


0,3485 


0,6075 


1,289 


6 


1,456 


0,5490 


0,3210 


1,947 


7 


1,185 


0,6820 


0,1712 


2,296' (5) 


8 


0,996 


0,7571 


0.1418* (6; 8) 


1,876 


9 


1,458 


0,5002 


0,3092 


1.602 


10 


1,474 


0^3360 


0,4578 


1,737 


11 


1,422 


0,5089 


0,2943 


1,865 


12 


1,418 


0,6009 


0,2899 


1,956 


13 


2,172 


0,2325 


0,6326 


1,444 


14 


1,215 


0,6220 


0,2362 


2,224* (4) 


Grubbs' statistics for cell averages 


Lever 


One smallest 


Two smallest 


Two largest 


One largest 


1 


1,070 


0,6607 


0,1291* (6; 9) 


1,832 


2 


1,318 


0,6288 


0,2118 


2.165 


3 


1,621 


0,4771 


0,4077 


1,680 


4 


1,591 


0,5339 


0,3807 


1,429 


5 


1,794 


0,4018 


0,5009 


1,333 


6 


1,291 


0,4947 


0,4095 


1.386 


7 


1,599 


0,5036 


0,4391 


1,470 


8 


1,872 


0,3753 


0,4536 


1.404 


9 


2,328* (5) 


0,1317* (4; 5) 


0,7417 


1,025 


10 


2,456** (5) 


- 


- 


1,000 


11 


1,756 


0,2469 


0.5759 


1,472 


12 


2,037 


0,1063* (5; 6) 


0,7116 


1,130 


13 


2,308* (5) 


0,0733** (5; 6) 


0,7777 


0,994 


14 


2,052 


0,2781 


0,5486 


1,576 


NOTE — Numbers in brackets indicate the labo 
The critical values of the Grubbs' test statistics fo 

Straggler 
D 
Grubbs' test for a single outlier 2,21 5 
Grubbs' test for a pair of outliers 0,149 2 


ratories that give rise to the stragglers or outliers. 

r 9 laboratories, whether applied to the differences or the cell av 

Outlier 

(") 

2,387 

0,085 1 


erages, are as follows. 
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Figure 1 — Example 1: Data obtained at Level 14 
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Figure 2 — Example 1 : Consistency check on cell differences (grouped by laboratory) 
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Figure 3 — Example 1 : Consistency check on cell averages (grouped by laboratory) 

5 A design for a heterogeneous material 

5.1 Applications of the design for a heterogeneous material 

5.1.1 An example of a heterogeneous material is leather; no two hides are the same, and the properties of leather 
vary substantially within a hide. A common test that is applied to leather is a tensile strength test in BS 3144 I^]. This 
is performed on dumbeil-shaped specimens (BS 3144 specifies the number of such specimens to cut from a hide, 
and also their position and orientation within the hide, so the natural definition of a "sample" to use when testing 
leather is a complete hide). If a precision experiment is performed using the uniform level design described in 
ISO 5725-2, in which each laboratory is sent one hide at each level of the experiment, and two test results are 
obtained on each hide, variation between hides will add to the between-laboratory variation, and so increase the 
reproducibility standard deviation. However, if each laboratory is sent two hides at each level, and two test results 
are obtained on each hide, the data can be used to estimate the vahation between hides and to calculate a value for 
the reproducibility standard deviation of the test method from which the variation between-hides has been removed. 

5.1.2 Another example of a heterogeneous material is sand (that might be used, for example, for making 
concrete). This is laid down, by the action of wind or water, in strata that always contain graduations in particle size, 
so when sand is used the particle size distribution is always of interest. In concrete technology the particle size 
distribution of sand is measured by sieve testing (e.g. BS 812-103 fl). To test a sand, a bulk sample is taken from 
the product, then one or more test portions are produced from the bulk sample. Typically, the bulk sample will be 
about 10 kg in mass, and the test portions will be about 200 g. Because of the natural variability of the materral, 
there will always be some variability between bulk samples of the same product. Hence, as with leather, if a uniform 
level experiment is performed in which each laboratory is sent one bulk sample at each level, the variability between 
the bulk samples will increase the calculated reproducibility standard deviation of the test method, but if laboratories 
are sent two bulk samples at each level, then values for the reproducibility standard deviation can be calculated that 
exclude this variation. 

5.1.3 The above examples also highlight another characteristic of heterogeneous materials: because of the 
variability of the material, the specimen or test portion preparation can be an important source of variation. Thus 
with leather, the process of cutting specimens from a hide can have a large influence on the measured tensile 
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strength, and with sieve tests on sand the process of preparing test portions from bulk samples is usually the major 
source of variability in the test method. If specimens or test portions are prepared for a precision experiment in a 
way that does not correspond to normal practice (in an attempt to produce identical "samples") then the values of 
repeatability and reproducibility standard deviations produced by the experiment will not be representative of the 
variability experienced in practice. There are situations in which it can be desirable to produce identical "samples" 
by some special process designed to eliminate, as far as possible, the variability of the material (for example, for a 
proficiency test, or when a precision experiment is used as part of a programme of work during the development of 
a measurement method). However, when the aim of the precision experiment is to discover the variability that will 
be experienced in practice (for example, when vendors and purchasers test samples of the same product) then it is 
necessary for the variability arising as a consequence of the heterogeneity of the material to be included in the 
measures of the precision of the measurement method. 

Care should also be taken to ensure that each test result in an experiment is obtained by carrying out the test 
procedure independently of other tests. This will not be so if some stages of the specimen preparation are shared 
by several specimens, so that a bias or deviation introduced by the preparation will have a common influence on the 
test results derived from these specimens. 

5.1.4 The design for heterogeneous materials proposed in this clause yields information about the variability 
between samples that is not obtainable from the uniform level design described in ISO 5725-2. There is, inevitably, 
a cost associated with obtaining extra information: the proposed design requires more samples to be tested. This 
extra information may be valuable. In the leather example discussed in 5.1.1, information about the variability 
between hides could be used to decide how many hides to test when assessing the quality of a consignment, or to 
decide between testing more hides with fewer specimens per hide or fewer hides with more specimens per hide. In 
the sand example discussed in 5.1.2, information about the variability between bulk samples could be used to 
decide if the procedure for taking bulk samples is satisfactory or in need of improvement. 

5.1.5 The design described in this clause is applicable to experinlents involving three factors arranged in a 
hierarchy: with a factor "laboratories" at the highest level in the hierarchy, a factor "samples within laboratories" as 
the next level in the hierarchy, and a factor "test results within samples" as the lowest level of the hierarchy. Another 
case that can be encountered in practice is of a three-factor hierarchy with "laboratories" at the highest level, "test 
results within laboratories" as the next level, and "determinations within test results" as the lowest level. This would 
arise if the participating laboratories in a precision experiment were each sent a single sample of a homogeneous 
material, were asked to carry out two (or perhaps more) tests per sample, and if each test involved a number of 
determinations and the test result is calculated as the average of the determinations. The formulae given in 5.5, 5.6 
and 5.9 may be applied to data obtained in such an experiment, but the repeatability and reproducibility standard 
deviations have to be calculated in a slightly different manner to that given here (see NOTE 2 to 5.5.5). It is also 
necessary to specify the number of determinations that are to be averaged to give a test result, because this affects 
the values of the repeatability and reproducibility standard deviations. 

5.2 Layout of the design for a heterogeneous material 

5.2.1 The layout of the design for a heterogeneous material is shown in table 9. 

The p participating laboratories are each provided with two samples at q levels, and obtain two test results on each 
sample. Thus each cell in the experiment contains four test results (two test results for each of two samples). 

It is possible to generalize this simple design, by allowing for more than two samples per laboratory per level, or for 
more than two test results per sample. The calculations required by the more general design are much more 
complicated than those required by the case with two test results per sample and two samples per laboratory per 
level. However, the principles of the more general design are the same as for the simple design, so the calculations 
will be set out in detail here for the simple design. Formulae for calculating values for the repeatability and 
reproducibility standard deviations for the general design are given below in 5.9, and an example of their application 
in 5.10. 

5.2.2 The data from the design for a heterogeneous material are represented by: 
yijtk 
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where 

subscript i represents the laboratory {« = 1 , 2, .... p'); 

subscript; represents the level (y = 1, 2, ..., q); 

subscript / represents the sample (r = 1, 2 g); 

subscript k represents the test result (k = ^,2, ..., n). 

Usually, g = 2 and n = 2. In the more general design, g or n or both are greater than two. 

NOTE — In ISO 5725-1 and ISO 5725-2, p is used both as the number of laboratories, and as an index in tables of critical 
values for Cochran's test: with the uniform-level experiment the two numbers are the same. With the design for a 
heterogeneous material, the index for Cochran's test can be a multiple of the number of laboratories, sop' is used here for the 
number of laboratories, and p for the index for Cochran's test. 

5.3 Organization of an experiment with a heterogeneous material 

5.3.1 Follow the guidance given in clause 6 of ISO 5725-1:1994 when planning an experiment with a 
heterogeneous material. An additional question has to be considered: 

how many samples should be prepared for each laboratory at each level? 

Usually, because of considerations of cost, the answer will be two. 

The formulae, tables and figures in clause 6 and annex B of ISO 5725-1:1994 may be used to help choose the 
number of laboratories, samples and replicates, but with the modifications set out in 5.3.2 to 5.3.5. 

5.3.2 The uncertainty of the estimate of the repeatability standard deviation, derived from an experiment on a 
heterogeneous material, may be assessed by calculating the quantity A^. introduced in subclause 6.3 of 
ISO 5725-1:1994 as: 

A,=\96^A/[2p'g{n-i)] (16) 

instead of as defined by equation (9) of 180 5725-1:1994. However, the above equation may be derived by 
replacing p in equation (9) of ISO 5725-1:1994 by p' x g. Hence, in ISO 5725-1:1994, figure B.I and the entries for 
repeatability under A^ in table 1 may be used by entering the figure or the table with p = p' x.g. Thus in the common 
case when g = 2 samples are to be prepared for each laboratory at each level, enter the table or the figure in 
ISO 5725-1 within p = 2p'. 

NOTE — The formulae for A^ above (and for /t^ below) have all been derived by the method described in NOTE 24 of 
ISO 5725-1:1994. 

5.3.3 The uncertainty of the estimate of the reproducibility standard deviation, derived from an experiment on a 
heterogeneous material, may be assessed by calculating the quantity ^4^ Introduced in subclause 6.3 of 
ISO 5725-1:1994 as: 



A^= 1,96^(Di-hD2-HD3)/(2y4) (1 7) 

instead of as defined by equation (10) of ISO 5725-1 :1994. Here 

Di =[(r^ -^)+(^^/9)+Vngf/{p'-^) 
D2=p/g)+(i/ng)]7[/''(9-i)] 
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03=l/[p'g(n-1)] 

- Oy^lctj {Ofj is defined later, in 5.4.1) 

r = c7R/(7, (18) 

The values of and /may be derived from preliminary estimates of the standard deviations o//, a^ and o> obtained 
during tine process of standardizing the measurement method. 

5.3.4 Follow the guidance given in clauses 5 and 6 of 130 5725-2:1994 with regard to the details of the 
organization of an experiment with a heterogeneous material. 

Subclause 5.1.2 of ISO 5725-2:1994 contains requirements for "the group of « tests" or "the group of n 
measurements" {for example, that the group of n tests should be carried out under repeatability conditions). In an 
experiment with a heterogeneous material, these requirements relate to the group of gxn tests in a cell, i.e. to all 
the tests in a laboratory at one level. 

In an experiment with a heterogeneous material, the number of samples that have to be prepared at each level is 
p' X g (i.e. 2p' in the usual case when g = 2). It is important that these p'xg samples are allocated to the 
participating laboratories at random. 

5.4 Statistical model for an experiment with a heterogeneous material 

5.4.1 The basic model used in this part of ISO 5725 is reproduced in 4.4.1 as equation (3). For an^xperiment with 
a heterogeneous material, this model is expanded to become: 

yijtk = ^j + ^ij + "ijt + ^ijtk (1 9) 

The terms m, B and e have the same meaning as in equation (3) in 4.4.1, but equation (19) contains an extra term 
Hij( that represents the variation between samples, and a subscript t representing samples within laboratories (the 
meaning of the other subscripts is given in 5.2.2). 

It is reasonable to assume that the variation between samples is random, does not depend on the laboratory, but 
may depend on the level of the experiment, so the term Hjp has a zero expectation, and a variance: 

var(Hij,) = <r% (20) 

5.4.2 For the usual case with two samples per laboratory, and two test results per sample (g = n = 2), define: 

a) the sample average, and the between-test-result range, for laboratory 1, levely and sample r (/ = 1 or 2) 

yyr=(yy,1 + %2)/2 (21) 

^ijt=\yijt^-yijt2\ (22) 

b) the cell average, and the between-sample range, for laboratory i, and level y 

y.j=(y>p+yij2)/2 (23) 

'^ij=\yip-yij2\ (24) 
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(25) 



=li{yu-yjf/ip'-^) 



(26) 



wliere the summation is over the laboratories i" = 1 , 2 p'. 

5.5 Statistical analysis of the data from an experiment with a heterogeneous material 

5.5.1 The usual case when two samples are prepared for each laboratory at each level, and two test results are 
obtained on each sample, is considered in detail here. (The general case is considered in 5.9 and 5.10.) 

Assemble the data into a table as shown in table 9. Each combination of a laboratory and a level gives a "cell" in this 
table, containing four test results. 

Using equations (21) to (26) given in 5.4.2: 

a) calculate the between-test-result ranges and enter them into a table as shown in table 10; 

b) calculate the between-sample ranges and enter them into a table as shown in table 11; 

c) calculate the cell averages and enter them into a table as shown in table 1 2; 
Record ranges as positive values (i.e. ignore the sign). 



Table 9 — RecommerLded form for collation of data from the design for a heterogeneous material 



Laboratory 


Sample 


Level 1 


Level 2 




Test 


1 2 


1 2 




1 


1 
2 








2 


1 

2 


















i 


1 
2 


















P' 


1 
2 









Level j 



Level q 



Test result number 



1 



I I 
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Table 10 — Recommended form for tabulation of between-test-result ranges for the design 

for a heterogeneous material 



Laboratory 


Sample 


Level 1 


Level 2 




1 


1 
2 








2 


1 
2 








1 
1 
1 










i 


1 
2 








1 


1 




1 


I 

1 
1 


P' 


1 
2 











Level; 









































Level q 



Table 11 — Recommended form for tabulation of between-sample ranges for the design 

for a heterogeneous material 



Laboratory 


Level 1 


Level 2 




1 








2 








1 
1 








i 








1 
1 

t 


1 
1 






P' 











Level j 









































Level q 



Table 12 — Recommended form for tabulation of ceil averages for the design 
for a heterogeneous material 



Laboratory 


Level 1 


Level 2 




1 








2 








I 
1 
1 








i 






1 

1 
1 




1 
1 
1 


P 









Level y 



Level q 
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5.5.2 If a cell in table 9 contains less than four test results (e.g. because sannples have been spoilt, or data have 
been excluded following the application of the outlier tests described below) then: 

a) either use the formulae for the general case given later, 

b) or ignore all the data in the cell. 

Option a) is to be preferred. Option b) wastes data, but allows the simple formulae to be used. 

5.5.3 For each level ; of the experiment, calculate the following. 

a) The sum of squared between-test-result ranges in column 7 of table 10 (summing over/j' laboratories and over 
two samples): 

p 2 

i=1f=1 

b) The sum of squared between-sample ranges in column j of table 1 1 (summing over p' laboratories): 

SSHj=J,^fj (28) 

(=1 

c) The average and standard deviation of the cell averages in column/ of table 12, using equations (25) and (26) 
in 5.4.2. 

5.5.4 Use tables 10, 11 and 12, and the statistics calculated in 5.5.3 to examine the data for consistency and 
outliers, as described in 5.6. If any data are rejected, recalculate the statistics. 

5.5.5 Calculate the repeatability standard deviation s^j and the reproducibility standard deviation s^j from: 
5§=55,,./(4p') (29) 

s% = si + (SSrj - SShj )l{Ap') (30) 

If this gives 

SRj<Srj (31) 

then set 

SRj=Srj (32) 

Calculate an estimate of the standard deviation that measures variation between samples Sf^j as: 

s%=SS„jl{2p')~SS,^l{Qp') (33) 

NOTES 

1 It may be of interest to perform a significance test to see if the variation between samples is statistically significant, however, 
this is not a necessary part of the analysis. It is incorrect to use such a test to decide if the variation between samples can be 
ignored in the analysis (so that the test results in each cell are treated as if they are all obtained on the same sample). This 
would introduce a bias into the estimation of the repeatability standard deviation, because finding that the variation between 
samples is not statistically significant does not prove that the variation between samples is negligible. 
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2 In the case described in 5.1.5 (when the three factors are "laboratories", "tests within laboratories" and "determinations 
within tests") the repeatability and reproducibility standard deviations should be calculated as: 



,/(4.') 



These formulae apply when the test result is calculated as the average of two determinations. 

5.5.6 Investigate whether s^j and s^j depend on the general average yj and, if so, deternnine the functional 
relationships, using the methods described in subclause 7.5 of ISO 5725-2:1994. 

5.6 Scrutiny of the data for consistency and outliers 

5.6.1 Examine the data for consistency using the h and k statistics, described in subclause 7.3.1 of 
ISO 5725-2:1994. 

To check the consistency of the cell averages, calculate the h statistics as: 

Plot these statistics to show up inconsistent laboratories, by plotting the statistics in the order of the levels, but 
grouped by laboratory. 

To check the consistency of the between-sample ranges, calculate the k statistics as: 

h-'^'il^^^^ (35) 

Plot these statistics to show up inconsistent laboratories, by plotting the statistics in the order of the levels, but 
grouped by laboratory. 

To check the consistency of the between-test- result ranges, calculate the k statistics as: 

kij, = Wij,/^SS,j/2p' (36) 

Plot these statistics to show up inconsistent laboratories, by plotting the statistics in the order of the levels, but also 
grouped by laboratory. 

The interpretation of these graphs is discussed fully in subclause 7.3.1 of ISO 5725-2:1994. If a laboratory is 
reporting generally biased results, then most of the h statistics for the laboratory, in the graph derived from the cell 
averages, will be large and in the same direction. If a laboratory is not carrying out the tests within levels under 
repeatability conditions (and allowing extraneous factors to increase the variation between the samples) then 
unusually large k statistics will be seen in the graph that is derived from the between-sample ranges. If a laboratory 
is achieving poor repeatability then it will give unusually large k statistics in the graph that is derived from the 
between-test- result ranges. 

5.6.2 Examine the data for stragglers and outliers using Cochran's and Grubbs' tests as described in subclauses 

7.3.3 and 7.3.4 of ISO 5725-2:1994. 

To test for stragglers and outliers in the between-test-result ranges, calculate Cochran's statistic for each leveiy as: 

C=w^axM, (37) 

where vv^^^x '^ ^^® largest of the between-test-result ranges Wjj^ for level j. 
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To use the table of critical values in subclause 8.1 of ISO 5725-2:1994, enter the table at the row corresponding to 
p = 2p' in the left-hand margin and in the column headed n-2. 

To test tor stragglers and outliers in the between-sample ranges, calculate Cochran's statistic for each level; as: 

C = vv2a^A5«7 (38) 

where w^^ is now the largest of the between-sample ranges w^■ for level j. 

To use the table of critical values in ISO 5725-2:1994, enter the table at the row corresponding to p = p' in the left- 
hand margin and in the column headed « = 2. 

To test for stragglers and outliers in the cell averages, calculate Grubbs' statistics from the cell averages as shown 
in subclause 7.3.4 of ISO 5725-2:1994 for each level ; (where s in ISO 5725-2:1994 is the j j defined by equation 
(26) in 5.4.2). 

The interpretation of these tests is discussed fully in subclause 7.3.2 of ISO 5725-2:1994. In an experiment on a 
heterogeneous material, the results of applying these tests should be acted on in the following order. First, 
Cochran's test should be applied to the between-test-result ranges. If it is decided, on the basis of this test, that a 
between-test- result range is an outlier and is to be excluded, then the two test results that give the outlying range 
should be excluded from the calculation of the repeatability and reproducibility standard deviations .(but the other 
test results in the cell should be retained). Next apply Cochran's test to the between-sample ranges, and finally 
apply Grubbs' tests to the cell averages. If it is decided that a between-sample range is an outlier, or that a cell 
average is an outlier, and that the results that give rise to such an outlier are to be excluded, then exclude all the 
test results for the appropriate cell from the calculation of the repeatability and reproducibility standard deviations. 

5.7 Reporting the results of an experiment on a heterogeneous material 

The references given in 4.7 apply equally to an experiment on a heterogeneous material. 

5.8 Example 2: An experiment on a heterogeneous material 

5.8.1 Aggregates that are used in the materials (cement-bound or bituminous-bound) that form the surfaces of 
airfields and highways have to be able to withstand wetting and freezing. A method that is used to measure their 
ability to do this is the magnesium sulfate soundness test l^l, in which a test portion of aggregate is subjected to a 
number of cycles of soaking in saturated magnesium sulfate solution, followed by drying. Initially the test portion is 
prepared so that it is all retained on a 10,0 mm sieve. The treatment in the test causes the particles to degrade, and 
the test result is the mass fraction of the test portion that passes the 10,0 mm sieve at the end of the test. A high 
result in the test (in excess of 10 % to 20 %) indicates an aggregate with poor soundness. 

5.8.2 The data shown in table 13 were obtained in an experiment in which pairs of samples of eight aggregates 
were sent to eleven laboratories, and two magnesium sulfate soundness test results were obtained on each sample. 
The samples were approximately 100 kg in mass (they were used for a number of other tests), and the test portions 
were approximately 350 g in mass. 

5.8.3 Tables 14, 15 and 16 show the between-test-result ranges, between-sample ranges, and cell averages, 
calculated using equations (21) to (24) in 5.4.2, for only Level 6 of the experiment. 

Using equations (27) and (28) in 5.5.3, the between-test-result ranges in table 14 and the between-sample ranges 
in table 15 give: 

SS,Q = 381,66 {%f SS„Q - 1 60,530 {%f 
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Applying equations (25) and (26) in 5.4.2 to the cell averages in table 16 gives: 

>'6 - 1 9,0 % (the general average) 

SyQ = 5,03 % 

so, using equations (29) to (33) in 5.5.5, the repeatability and reproducibility standard deviations, and the standard 
deviation that measures variation between samples, are: 

5^6 = 2,95 % s^e = 5,51 % SffQ = 1,72 % 

Table 17 gives the results of the calculations for the other levels. 

5.8.4 Figure 4 shows histograms of between-test-result ranges, between-sample ranges, and cell averages, for 
Level 6. Graphs of this type give an easily understood picture of the amount of variation arising from the different 
sources (between test results, between samples, and between laboratories). Figure 4 shows that, in this 
experiment, at Level 6, there is wide variation between the cell averages, so that, if the test method were to be used 
in a specification, it is likely that disputes would arise between vendors and purchasers because of differences in 
their results. The between-sample ranges are smaller than the between-test-result ranges, suggesting that variation 
between samples is not important, at Level 6. 



5.8.5 Values of the h and k statistics, calculated as described in 5.6.1, are also shown in tables 14, 15 and 16, for 
Level 6. The values for all levels are plotted in figures 5 to 7. (In these figures, the levels have been re-arranged so 
that the general averages are in increasing order — as shown in table 17.) Figure 5 shows that Laboratory 6 
obtained several high k statistics for between-test-result ranges, indicating that it has poorer repeatability than the 
other laboratories. Figure 6 shows that three laboratories (1 , 6 and 10) obtained high k statistics for between-sample 
ranges: this could be because they did not strictly follow the recommended procedures for preparing test portions 
from the bulk samples. Figure 7 shows consistent positive or negative h statistics in most laboratories (with 
Laboratories 1, 6 and 10 again achieving the largest values). This is strong evidence that there are consistent 
biases in most laboratories, indicating that the test method is not adequately specified. 

5.8.6 Applying Cochran's test and Grubbs' test to the data, as described in 5.6.2, gives the results shown in 
table 18. Two outliers are identified. In the absence of other information, the data responsible for these would be 
excluded, and the calculations repeated. The analysis could then be continued with an investigation of functional 
relationships, in the same way as with the uniform level design considered in ISO 5725-2. 
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Figure 4 — Example 2: Histograms of ranges and averages from tables 14, 15 and 16, for Level 6 
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Figure 5 — Example 2: Consistency check on between-test-result ranges 

(grouped by laboratory) 
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Figure 6 — Example 2: Consistency check on between-sample ranges 

(grouped by laboratory) 
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Table 13 — Example 2: Determination of magnesium sulfate soundness (%) 



Laboratory 


Sample 


Level 1 


Level 2 


Level 3 


Level 4 


Test result number | 


1 2 


1 2 


1 2 


1 2 


1 


1 
2 


69,2 67,0 
69,7 71,7 


7,4 8,0 
6,6 5,7 


4,1 3,5 
10,5 13,1 


10,4 10,1 
13.9 13,8 


2 


1 
2 


66,5 64,1 
65,7 65,8 


1,9 2,1 
4,2 3,3 


3.0 3,2 
1.9 1,1 


8,7 6.7 
8,3 4,8 


3 


1 
2 


68,7 69,5 
67,7 77,7 


6,3 5,8 
9,7 5,3 


2,4 2,9 
2,1 3,3 


11,7 7.0 
7,9 12,0 


4 


1 
2 


77,5 75.3 
76,3 77,2 


2,0 3,6 
4,7 3,8 


2,4 1 ,4 
6,4 2,3 


9,4 7,1 
10,7 7,7 


5 


1 
2 


55,4 63,2 
65,9 54,7 


3,8 4,1 
2,1 3,1 


1.3 0,8 
0,7 1,7 


3,7 6,3 
3,3 3.7 


6 


1 
2 


64,8 70,9 
78,2 73.4 


8,4 6,1 
8,3 10,6 


6.0 9,7 
12.4 9,8 


16,5 12.3 
13,2 16,8 


7 


1 
2 


64,8 63,4 
67,0 63,4 


4,3 5,7 
7,7 3,9 


2,9 3,0 
4,3 6,4 


7,5 9,3 
11,1 8.3 


8 


1 
2 


64,9 68,4 
65,4 65,5 


4,4 2,8 
5,4 6,7 


1.3 2,8 
2,7 2,8 


5.7 6.8 

4.8 5.5 


9 


1 
2 


I z 


— — 


1,1 0,0 
0,7 3,7 


6,6 7,0 
4,9 6.3 


10 


1 
2 


57.0 57,7 

57.1 52,7 


3,3 0,4 
4,2 2,3 


2,1 2,4 
3,6 3,5 


5,5 5,8 
3,9 5.7 


11 


1 
2 


70,6 75.2 
77,9 68,2 


5,3 6,4 
3,5 7,1 


5,7 1,9 
1,4 3,0 


9,5 7.2 
8.1 7.4 


Laboratory 


Sample 


Level 5 


Level 6 


Level 7 


Level 8 


Test result number 


1 2 


1 2 


1 2 


1 2 


1 


1 
2 


8,9 7,4 
7,6 9,1 


31,1 28,5 
23,0 23,1 


38,7 41,7 
44.2 41,1 


4.2 4,1 

7.3 4,4 


2 


1 
2 


3,2 3,5 
2,8 4,0 


16,5 15,4 
10,3 12,8 


36,6 45,2 
43,2 40,5 


3,2 5,4 
1,7 2.5 


3 


1 
2 


4,4 6,1 
6,0 6,0 


24,3 16,7 
20,8 22,2 


38,9 43.1 
46,1 47,4 


3,7 7,7 
3.5 5,6 


4 


1 
2 


2,7 3,1 
2,3 2,9 


20,2 16,2 
20,0 11,9 


32,0 35,5 
26,5 35.7 


2.9 2.2 
3,2 2,3 


5 


1 
2 


1,3 1.4 
1,5 1,3 


13.8 15,1 
11,5 13,3 


36.7 39,5 
37,6 34.1 


1,1 1,2 
0,6 A, 7 


6 


1 
2 


8,2 4,2 
3,7 4.6 


20,3 24,7 
21,0 18,9 


49,4 50,6 
48,2 52,4 


11,9 18,5 
14,9 8,1 


7 


1 
2 


3,1 5,5 
5,6 5.5 


27.2 23,3 
21,5 22,7 


38,9 29.9 
34,4 38,3 


- 1,7 
2,2 5,0 


8 


1 
2 


1,8 2,2 
4,0 4,0 


13,6 12,0 
15,6 16.7 


27,0 37,0 
39,7 34,6 


0,3 2,2 
3,6 3,7 


9 


1 
2 


3,8 3,8 
3,5 2.8 


17,7 17,1 
21.4 16,8 


33.4 33,1 

26.5 25,2 


1,8 2,0 
2,5 1,6 


10 


1 
2 


3,5 3.0 
3,2 3,5 


21,7 23,9 
27.0 32,5 


35,3 26.5 
18,0 18.2 


0,5 4,3 
2,0 2,1 


11 


1 
2 


3,5 2.5 
2,0 2,8 


11.0 18.4 
16,4 8.1 


27,0 33,5 
35,4 29.3 


5,1 3,9 
2,1 5,0 
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Table 14 — Example 2: Between-test-result ranges for Level 6 



Laboratory 


Sample 


Between-test-result 
range 

% 


k Statistic 


1 


1 
2 


2,6 
0,1 


0,624 
0,024 


2 


1 
2 


1.1 
2,5 


0,264 
0,600 


3 


1 
2 


7,6 

1,4 


1,825 
0.336 


4 


1 
2 


4.0 
8.1 


0.960 
1.945 


5 


1 
2 


1,3 
1,8 


0.312 
0.432 


6 


1 
2 


4,4 
2,1 


1,056 
0,504 


7 


1 
2 


3,9 
1,2 


0,936 
0,288 


8 


1 
2 


1,6 

1,1 


0,384 
0.264 


9 


1 
2 


0.6 
4,6 


0.144 
1.104 


10 


1 
2 


2,2 
5.5 


0,528 
1,320 


11 


1 
2 


7,4 
8.1 


1,777 
1,945 



Table 15 — Example 2: Between-sample ranges 
for Level 6 



Table 16 — Example 2: Cell averages for Level 6 



Laboratory 


Between-sample 
range 

% 


k statistic 


1 


6.75 


1,767 


2 


4,40 


1,152 


3 


1,00 


0,262 


4 


2,25 


0,589 


5 


2,05 


0,537 


6 


2,55 


0,668 


7 


3,15 


0,825 


8 


3,35 


0.877 


9 


1,70 


0.445 


10 


6.95 


1,819 


11 


2.55 


0.668 



Laboratory 


Cell average 

% 


h statistic 


1 


26.425 


1,475 


2 


13.750 


-1.043 


3 


21.000 


0,397 


4 


17.075 


-0,382 


5 


13.425 


-1,108 


6 


21,225 


0,442 


7 


23,675 


0.929 


8 


14,475 


-0.899 


9 


18,250 


-0.149 


10 


26,275 


1.445 


11 


13,425 


-1.108 
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Table 17 — Example 2: Values of averages, sums of squared ranges, and standard deviations, calculated 
from the data for all 8 levels in table 13 (excluding cells with missing data) 



Level 

J 


Number of 
laboratories 

p' 


General 
average 


Sums of 
ran 


squared 
ges 


Syj% 


Standard deviations 


S„j% 


3 


11 


3,7 


82,99 


96,3725 


2,62 


1,37 


2,56 


1,85 


5 


11 


4,0 


34,70 


1 1 ,2550 


1,88 


0,89 


2,01 


0,34 


8 


10 


4,1 


155,39 


29,4225 


3,49 


1,97 


3,92 


0,00 


2 


10 


5,0 


83,51 


25,2375 


1,95 


1,44 


2,29 


0,47 


4 


11 


8,2 


131,07 


23,5775 


3,10 


1,73 


3,47 


0,00 


6 


11 


19,0 


381,66 


160,5300 


5,03 


2,95 


5,51 


1,72 


7 


11 


36,5 


636,19 


305,4775 


7,28 


3,80 


7,78 


2,58 


1 


10 


67,4 


529,71 


92,9225 


6,23 


3,64 


7,05 


0,00 
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8 


10 


0,849 


— 


— 


2,643" (6) 


2 


10 


1,259 


0,614 


0.466 


1,713 


4 


11 


1,290 


0,681 


0.294 


2,082 


6 


11 


1,108 


0,700 


0.479 


1,475 


7 


11 


1,649 


0,562 


0.453 


1,875 


1 


10 


1,808 


0,345 


0,590 


1,476 



NOTE — Numbers in brackets indicate the laboratories ttiat gives rise to the stragglers or outliers. The critical values are as follows: 



Statistical test 



Cochran's test 



Cochran's test 



Applied to 



Between-test-result 
ranges 

Between-sample ranges 



Grubbs' test for a single Cell averages 
outlier 

Grubbs' test for a pair of Cell averages 
outliers 



Number of 


Index 


in table in 


Straggler 


laboratories 


ISO 5725-2 




P 




P 


(*) 


10 




20 


0,389 


11 




22 


0,365 


10 




10 


0.602 


11 




11 


0.570 


10 




10 


2,290 


11 




11 


2,355 


10 




10 


0,186 4 


11 




11 


0,221 3 



Outlier 

(") 

0,480 
0,450 

0,718 
0,684 

2,482 
2,564 

0.115 
0,144 8 
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= sample average - laboratory average 
where n^^, is the number of test results included in the sum. 

d) The residuals for each /, t and k: 

= test result - sample average 

e) The sum of squares for samples (with summation over i): 

f) The sum of squares for samples (with summation over / and t): 

g) The sum of squares for repeatability (with summation over i, t and k): 

^^. = 1114. 

h) Degrees of freedom: 

VLj =Pj - 1 -yHj =gj- Pj ^rj = "j -gj 

where 

p'j is the number of laboratories that report at least one test result; 

gj is the number of samples for which at least one test result is reported; 

tij is the total number of test results. 



(42) 



(43) 



(44) 



(45) 



(46) 
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i) Factors for each i (with summation over t): 

nij=J,n,j, (47) 

j) Factors (with summation over /): 

K,=^n^ (49) 

K-=J^K, (50) 

k) The repeatability standard deviation s^j, between-samples standard deviation s^y, between-laboratory standard 
deviation s^j, and reproducibility standard deviation .s^ using: 

sfj^SS^jjv.j (52) 

s% = [SS„J -v„jx s^j y(nj - Kj) (53) 

dj = [sSlj - [kj - K] jn^ ) X s% -vi^j X sfj ]/(/t^ - Kj /nj) (54) 

NOTE — The above formulae were derived using statistical theory set out by Scheffe t'*'. 

5.10 Example 3: An application of the general formulae 

5.10.1 The data of Example 2, Level 4, are used to provide an example of the application of the general formulae 
by omitting some of the test results (see table 19). The formulae presented in 5.9 give the general average shown 
under table 1 9 and the sums of squares, degrees of freedom and factors shown under tables 20, 21 and 22. 

5.10.2 Applying equations (52) to (55) in step k) of 5.9 then gives: 
= 3^895 0/16 %2 



so 



j^^=1,52% 



and 

s%j=[sSHj-VHjXsfj]/(nj-Kj) 

= [29,907 5-9x1.518 5^1 /(36 - 1 9,667) %^ 



30 




Laboratory 


Sample 


Test result 


Test result 


( 


t 


t=1 


k = 2 






% 


% 


1 


1 


— 


10,1 




2 


13.9 


13,8 


2 


1 


— 


— 




2 


8,3 


4,8 


3 


1 


— 


7,0 




2 


— 


12,0 


4 


1 


9,4 


— 




2 


— 


— 


5 


1 


3,7 


6,3 




2 


3,3 


3,7 


6 


1 


16,5 


12,3 




2 


13,2 


16,8 


7 


1 


7,5 


9.3 




2 


11.1 


8.3 


8 


1 


5,7 


6,8 




2 


4,8 


5.5 


9 


1 


6,6 


7,0 




2 


4,9 


6,3 


10 


1 


5,5 


5.8 




2 


3,9 


5,7 


11 


1 


9,5 


7.2 




2 


8,1 


7.4 


General average: 


mj. = 8.111 1 % 






Number of test results: 


ny = 36 
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Table 20 — Example 3: Calculation of the sum of squares for laboratories 



Laboratory 

1 


Laboratory 
average 

% 


Number of 
test results 


Laboratory 
effect 

% 


Factor 


1 


12,600 


3 


4,488 9 


5 


2 


6,550 


2 


-1,561 1 


4 


3 


9,500 


2 


1,388 9 


2 


4 


9,400 


1 


1,288 9 


1 


5 


4,250 


4 


- 3,861 1 


8 


6 


14,700 


4 


6,588 9 


8 


7 


9,050 


4 


0,938 9 


8 


8 


5,700 


4 


-2,411 1 


8 


9 


6,200 


4 


-1,911 1 


8 


10 


5,225 


4 


- 2,886 1 


8 


11 


8,050 


4 


- 0,061 1 


8 


Sum of squares for laboratories: SS, - 378,853 1 %2 

Degrees of freedom for laboratories: v^ = 1 1 - 1 = 1 

^^(^^ors: tCj = 1 30 K) = 68 K", = 1 9,666 7 



Table 21 — Example 3: Calculation of the sum of squares for samples 



Laboratory 


Sample 


Sample 
average 

% 


Number of 
test results 


Sample effect 

% 


1 


1 
2 


10,10 
13,85 


1 

2 


- 2,500 
1,250 


2 


1 
2 


6,55 



2 


0,000 


3 


1 
2 


7,00 
12,00 


1 
1 


- 2.500 
2,500 


4 


1 
2 


9,40 


1 



0,000 


5 


1 
2 


5,00 
3,50 


2 
2 


0,750 
- 0,750 


6 


1 
2 


14,40 
15,00 


2 
2 


- 0,300 
0.300 


7 


1 
2 


8,40 
9,70 


2 
2 


- 0,650 
0,650 


B 


1 
2 


6,25 
5,15 


2 
2 


0,550 
- 0,550 


9 


1 
2 


6,80 
5,60 


2 
2 


0,600 
- 0,600 


10 


1 
2 


5,65 
4.80 


2 
2 


0,425 
- 0,425 


11 


1 
2 


8,35 
7,75 


2 
2 


0,300 
- 0,300 


Sum of squares for samples: 55^ 
Degrees of freedom for samples: v„, 


jj = 29,907 5 %2 
= 20 - 1 1 = 9 
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Table 22 — Example 3: Calculation of the sum of squares for repeatability 



Laboratory 

1 


Sample 

f 


Test result 
;t=1 

% 


Test result 

k = 2 

% 


1 


1 
2 


0,05 


0,00 
-0,05 


2 


1 
2 


1,75 


-1,75 


3 


1 
2 


— 


0,00 
0,00 


4 


1 
2 


0,00 


— 


5 


1 
2 


-1,30 
-0,20 


1,30 
0,20 


6 


1 
2 


2,10 
-1,80 


-2,10 
1,80 


7 


1 
2 


-0,90 
1,40 


0,90 
-1,40 


8 


1 
2 


-0,55 
-0,35 


0,55 
0,35 


9 


1 

2 


- 0,20 
-0,70 


0,20 
0,70 


TO 


1 
2 


-0,15 
-0,90 


0,15 
0,90 


11 


1 
2 


1,15 
0,35 


-1,15 
-0,35 


Sum of squares for repeatability: 55 = 36,895 %2 
Degrees of freedom for repeatability: v = 36 - 20 = 1 6 



6 Robust methods for data analysis 

6.1 Applications of robust methods of data analysis 

6.1.1 In ISO 5725-2, it is recommended that two tests for outliers (Cochran's test and Grubbs' test) should be 
applied to the data obtained in a precision experiment, and any data that give rise to a test statistic in one or other of 
these tests that exceeds the critical value of the test at the 1 % significance level should be discarded (unless the 
statistician has good reason to retain the data). In practice, this procedure is often not easy to apply. Consider the 
results of the outlier tests in Example 1 of 4.8. These are given in table 8. Laboratory 5 gives only one cell average 
(at Level 10) that is sufficiently extreme to be classed as an outlier by Grubbs' test, but gives three other stragglers, 
and a strong indication in figure 3 that something is amiss in this laboratory. The statistician, in this situation, has to 
decide between: 

a) retaining all the data for Laboratory 5; 

b) discarding only the data from Level 1 for Laboratory 5; 

c) discarding ail the data for Laboratory 5. 

His/her decision will have a substantial influence on the calculated values for the repeatability and reproducibility 
standard deviations. It is a common experience when analysing data from precision experiments to find data that 
are on the borderline between stragglers and outliers, so that judgements may have to be made that affect the 
results of the calculation. This may be unsatisfactory. The robust methods described in this clause allow the data to 
be analysed in such a way that it is not required to make decisions that affect the results of the calculations. Thus if 



33 




performed using 'Algorithm S' and cell standard deviations are not excluded as a result of applying Cochran's test. 
With either approach (that described in ISO 5725-2 or that described here), the two measures are then used to 
calculate estimates of the repeatability and reproducibility standard deviations in the same way. 
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A more complicated example is the 6-factor staggered-nested design given in annex C of ISO 5725-3:1994. With 
this design, the first stage of the analysis is to calculate the average of the data for each laboratory (at each level), 
denoted y^^y ... , y^i^y and a series of ranges, denoted w,([j, ... , w^^jj, that contain information about the variability 
attributable to the various factors examined in the experiment. To analyse the data using the robust methods 
described here, 'Algorithm A' is applied to the cell averages, and 'Algorithm S' is applied to each series of ranges 
in turn. The statistics obtained by these operations are then used to obtain estimates of repeatability, intermediate 
precision and reproducibility standard deviations, in the same way as if the method of analysis described in 
ISO 5725-3 were being used. 

6.1.7 The robust methods that are included in this part of ISO 5725 were chosen because they can be applied to 
all the experimental designs given in parts 2, 3, 4 and 5 of ISO 5725, and because the calculations they require are 
relatively simple. It should be noted, however, that they provide a means of combining, in a robust manner, cell 
averages, cell standard deviations and cell ranges. They do not combine individual test results in a robust manner, 
i.e. they start with the arithmetic cell averages and the cell standard deviations. There are robust methods that 
combine test results within cells in a robust manner, and they would be more complicated to apply in practice. 

6.2 Robust analysis: Algorithm A 

6.2.1 This algorithm yields robust values of the average and standard deviation of the data to which it is applied, 
and is applied to: 

a) cell averages, in any design; 

b) cell differences, in the split-level design. 

6.2.2 Denote the p items of data, sorted into increasing order, by: 

Denote the robust average and robust standard deviation of these data by x'and s*. 

6.2.3 Calculate initial values for j:* and 5* as: 

x*= median of jc,- (/ = 1, 2, ..., p) (56) 

s' = 1 ,483 X median of |.t, - ^ i (' = ■"■ 2. ••- p) (5^) 

6.2.4 Update the values of j: * and s'as follows. 
Calculate: 

<p-1,5 5* (58) 

For each x^ value [i = 1, 2, ..., p) , calculate: 

x*~ <p if JCj < X*- (p 

x*+ <p if JC, > x*+ <p (59) 

Xj otherwise 

Calculate the new values of x* and s* from: 

x*=i^x:/p (60) 

1=1 
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s* = 1,134l|;{x;-x*f/(p-i) (61) 

6.2.5 The robust estimates ;c*and 5* may be derived by an iterative calculation, i.e. by repeating the calculations in 
6.2.4 several times, until the change in the estimates of j;* and s*from one calculation to the next is small. This is a 
simple method to program on a computer. 

6.2.6 An alternative method that does not involve iteration and so may be easier to apply if the calculations are 
being done by hand, is derived by observing that equations (60) and (61) in 6.2.4 may be written: 

x*=x' + X5x (hu-«l>*/(p-"L-«u) (62) 

(5*)2 =(p-ML-«u-l) X (5')^/[(p-1)/t1342-t5^(pML + P«U-4«L"u)/(p-"L-«u)] (63) 

where 

Ml is the number of data items Xj for which x, < x'- (p; 

uyj is the number of data items x^ for which Xj >x*+ cp; 

x and s' are the average and standard deviation of the (p-u^- u^^} data items x^ for which [xj - x *| < ip. 

These may be used to calculate x* and s* directly if ml ai^cl My are known. One approach is to try the various 
possibilities in a systematic order (i.e. try «l = 0. "u = 0; ^hen ml = 0. "u = "I ! then ml = 1 , mu = 0; then ml = 1 . "u = 1 ; 
and so on) until a valid solution is found in which the actual numbers of items of data more than 1,5j*from x* equal 
the values of ul and uy "^sed to calculate x*and x*. In practice, the analyst will be able to use histograms such as 
those shown in figure 4 to identify the values that are likely to differ from x* by more than ^,Ss*, and so find the 
solution by evaluating a small number of cases. 

A further possibility is to use the iterative method to find an approximate solution, then solve equations (62) and (63) 
to find the exact solution. This is the approach that is used in the examples that follow. 

6.3 Robust analysis: Algorithm S 

6.3.1 This algorithm is applied to within-laboratory standard deviations (or within-laboratory ranges) in any design. 
It yields a robust pooled value of the standard deviations or ranges to which it is applied. 

6.3.2 Denote the p items of data, sorted into increasing order, by: 
w^, W2, ..., w,-, ..., Wp 

(These may be ranges or standard deviations). 

Denote the robust pooled value by w*, and the degrees of freedom associated with each Wj by v. (When w, is a 
range, v = 1 . When w, is the standard deviation of n results, v = n - 1 .) Obtain the values of ^ and rj required by the 
algorithm from table 23. 

6.3.3 Calculate an initial value for w*as follows. 

w*= median of w, (' = 1 , 2 p) (64) 

6.3.4 Update the.value of w* as follows. 
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Calculate: 

\j/= rjxw* 

For each w- (/ = 1 , 2, .... p), calculate: 

fy/ if Wj > y/ 
[wj otherwise 

Calculate the new value of w'from: 
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(65) 



(66) 



-^jiy'f/p 



(67) 



6.3.5 The robust estimate w* may be derived by an iterative calculation by repeating the calculations in 6.3.4 
several times, until the change in the estimate of w* from one calculation to the next is small. This is a simple 
method to program on a computer. 

6.3.6 An alternative method, that does not involve iteration, and so may be easier to apply if the calculations are 
being done by hand, is similar to that described in 6.2.6. Equation (67) in 6.3.4 may be written: 

(wf=[e/p] X I'(w*)%«u X (nwf (68) 

where 

Z, is the summation over the w, for which w^ < y/; 

uu is the number of w, for which w, > ij/. 

This may be solved by trying «u = 0, «u = 1, «u = 2, and so on in turn, until a valid solution is obtained in which the 
actual number of w- that exceed tj x w*is equal to u\j- In practice the analyst will be able to use histograms such as 
those shown in figure 4 to identify the ranges that are likely to exceed tjxw* and find the solution by evaluating a 
small number of cases. 

The approach that is used in the examples that follow is to use the iterative method to find an approximate solution, 
then solve equation (68) to find the exact solution. 

Table 23 — Factors required for robust analysis: Algorithm S 



Degrees of freedom 

V 


Limit factor 


Adjustment factor 


1 


1 ,645 


1,097 


2 


1,517 


1,054 


3 


1,444 


1,039 


4 


1,395 


1,032 


5 


1,359 


1,027 


6 


1,332 


1.024 


7 


1,310 


1,021 


8 


1,292 


1,019 


9 


1,277 


1,018 


10 


1,264 


1,017 


NOTE — The values of ^ and 77 are derived in annex B. 
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6.4 Formulae: Robust analysis Yor a particular level of a uniform-level design 

6.4.1 With a uniform-level design, a robust estimate of the repeatability standard deviation s^ for a level may be 
obtained by applying Algorithm S to the cell ranges or cell standard deviations for the level to derive a robust value 
w*from equation (67) in 6.3.4. If Algorithm 8 is applied to the cell standard deviations, then 

s,=w* (69) 

If there are two measurement results per cell and Algorithm 8 is applied to the cell ranges, then 

s,=w*l^ (70) 

6.4.2 A robust estimate of the standard deviation of ceil averages s^ for a level may be obtained by applying 
Algorithm A to the cell averages for the level to obtain a robust value j'from equation (61) in clause 6.2.4, and then 
using 

^d=^' (71) 

6.4.3 Next the between- laboratory standard deviation 5l may be derived using 

'l-W-Wh) (72) 

where n is the number of measurement results per cell. 
If the expression under the square root is negative then set 

^L = (73) 

Calculate the reproducibility standard deviation for the level as 

sn = ^sl+sf (74) 

6.5 Example 4: Robust analysis for a particular level of a uniform-level design 

6.5.1 Example 3 in ISO 5725-2:1994 is an example of a uniform-level design in which the data contain stragglers 
and outliers. Level 5 in that example is of particular interest because Laboratory 1 gave a cell average that was 
shown to be a near-straggler by Grubbs' test, and Laboratory 6 gave a cell range that was shown to be a near- 
straggler by Cochran's test. These data are reproduced here in table 24. 

6.5.2 If the data from all the laboratories are retained, the repeatability and reproducibility standard deviations may 
be estimated using the formulae in clause 7.4 of ISO 5725-2:1994, giving: 

p = 9 

m = 20,511 

s^ = 0,585 

Sd = 1,727 

s, = 1,677 



iff = 



1,776 
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6.5.3 However, according to ISO 5725-2, the data analyst used information from otiier levels in the experiment, 
and suspicions concerning the identity of the samples tested by Laboratory 6, to justify excluding data from both 
Laboratories 1 and 6 from the calculation, giving: 



p 


= 


7 


m 


= 


20,412 


'r 


- 


0.393 


^d 


= 


0,573 


^L 


= 


0,501 


Sr 


z= 


0,637 



Clearly the decision to exclude the data from the two laboratories has had a substantial effect on the estimates of 
the repeatability and reproducibility standard deviations. 

6.5.4 The first step in the analysis is to obtain a robust estimate of the repeatability standard deviation. The 
calculations may be set out conveniently as shown in table 25, in which the cell ranges have been sorted into 
increasing order. Applying Algorithm S using iteration gives the results shown in this table. In this example the 
degrees of freedom of each cell range is v = 1, so ^ = 1,097 and 77 = 1,645. From the four iterations shown in the 
table it appears that the robust value w* ~ 0,7 and only one cell range (wg =1,98) exceeds \\i. If the calculations 
were being done on a computer, the process could be allowed to continue until the change in the value w* from one 
iteration to the next is small. 

The solution may also be derived directly, as follows. Using equation (68) in 6.3.6 with: 
"U = 1 



W>1h 



0.249 5 



gives 

(w*)^=1.0972 X 0,249 5 + (t097 x t645w*)^/9 
giving the solution {if the assumption hj = 1 is correct) of: 

w'^ 0,69% creosote 

It may then be confirmed that this value gives v^= 1,645 x 0,69 = 1,14, so, as assumed, only wg exceeds v^and 
further that replacing wg by 1,14 gives w*= 0,63 x 1,097 = 0,69, again, so that the solution is shown to be valid. 

The estimate of the repeatability standard deviation is thus: 

s, = 0,69 / V2 = 0,49 % creosote 

This lies between the two estimates given in 6.5.2 and 6.5.3. 

6.5.5 The next step in the analysis is to obtain a robust estimate of the standard deviation of the cell averages. 
Applying Algorithm A to the cell averages gives the results shown in table 26, where now the cell averages have 
been sorted into increasing order. From the four iterations shown in the table it appears that the robust values are 
x*=: 20,412 and 5*= 1,1, and that only the two extreme cell averages (x\ =17,570, xg =24,140) differ from jc* by 
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more than (p. If the calculations were being done on a computer, the process could be allowed to continue until the 
changes in the values x* and s* from one iteration to the next are small. 

If the calculations are being done by hand, the data analyst should use the direct method described in 6.2.6 and try: 

"L = «u - 1 
This gives 

x' = 20,412 and s' = 0,573 % creosote 

Hence from equations (62) and (63) in 6.2.6 

{.rf =6 X (0,573)^/ [8/ 1,1342 -1,52(9 + 9 -4)/ 7] 

giving: 

J* = 1070% creosote 
and 

x* = x' = 20,412 % creosote 

It may then be confirmed that this value of s* gives (p = 1,605 (so, as assumed, only x\ and xg differ from 
x*= 20,412 by more than <p), and that replacing xj by 18,807 and xg by 22,017 gives a new value x*= 20,412 and 
a new value s* = 0,944 x 1,134 = 1,070 again, so the solution is shown to be valid. 

The estimate of the between-laboratory standard deviation is thus, from equation (72) in 6.4.3: 

^L = Jt0702 -(0,492/2) = 1,012 7o creosote 
and the estimate of the reproducibility standard deviation is, from equation (74) in 6.4.3: 



J;; - Vt0122 +0.492 =1124% creosote 
Again, this lies between the two estimates given in 6.5.2 and 6.5.3. 



Table 24 — Example 4: Thermometric titration of creosote oil 



Laboratory 


Data 

% creosote 


Cell average 

% creosote 


Cell range 

% creosote 


1 


24,28 24,00 


24,140 


0,28 


2 


20,40 19,91 


20,155 


0,49 


3 


19,30 19,70 


19,500 


0,40 


4 


20.30 20,30 


20,300 


0,00 


5 


20,53 20,88 


20,705 


0.35 


6 


18,56 16,58 


17,570 


1,98 


7 


19,70 20,50 


20,100 


0,80 


8 


21,10 20,78 


20,940 


0,32 


9 


20,71 21,66 


21,185 


0,95 
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Table 25 — Example 4: Applying Algorithm S to the cell ranges (% creosote) 

(v=1;^= 1,097; rj= 1,645) 



Iteration 


OD 


1 


2 


3 


4 


V 


— 


0.66 


0,86 


1,00 


1,09 


Wi* 


0,00 


0,00 


0,00 


0,00 


0,00 


W'2 


0,28 


0,28 


0,28 


0,28 


0,28 


M'3 


0,32 


0,32 


0,32 


0,32 


0,32 


H'4 


0,35 


0,35 


0,35 


0,35 


0.35 


w's 


0,40 


0,40 


0,40 


0,40 


0,40 


H'e 


0,49 


0,49 


0,49 


0,49 


0.49 


wj 


0,80 


0,66 


0,80 


0,80 


0.80 


Vfg 


0,95 


0,66 


0,86 


0,95 


0,95 


Wg 


1,98 


0,66 


0,86 


1,00 


1,09 


Pooled w 
New w' 


0,83 
0,40 2) 


0,47 
0,52 


0,56 
0,61 


0.60 
0,66 


0,62 
0,68 


1 ) The column for iteration is taken from table 24 after rearrangement in Increasing order. 

2) 0,40 is the median range [see equation (64) in 6.3.3], 



Table 26 — Example 4: Applying Algorithm A to the cell averages (% creosote) 



Iteration 


OD 


1 


2 


3 


4 


V 


— 


1,424 


1,478 


1,514 


1,539 


x'~ (p 

x*+ (p 


— 


18,876 
21,724 


18,909 
21,865 


18,893 
21,921 


18,872 
21,950 


A 


17,570 


18,876 


18,909 


18,893 


18,872 


X2 


19,500 


19,500 


19,500 


19,500 


19,500 


^3 


20,100 


20,100 


20.100 


20,100 


20,100 


A 


20,155 


20,155 


20,155 


20,155 


20,155 


x's 


20,300 


20.300 


20.300 


20,300 


20,300 


x'e 


20,705 


20,705 


20,705 


20,705 


20,705 


x? 


20,940 


20,940 


20,940 


20,940 


20,940 


xb 


21,185 


21,185 


21,185 


21,185 


21,185 


^9 


24,140 


21,724 


21.865 


21,921 


21,950 


Average 


20,511 


20,387 


20.407 


20,411 


20,412 


Standard 
deviation 


1,727 


0,869 


0,890 


0,905 


0,916 


Uew x' 
New s' 


20,300 2) 
0,949 2) 


20,387 
0,985 


20,407 
1,009 


20,411 
1,026 


20,412 
1.039 


t) The column for iteration is taken from table 24 after rearrangement in increasing order. 
2) 20,300 and 0,949 are derived using equations (56) and (57) in 6.2.3. 
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6.6 Formulae: Robust analysis for a particular level of a split-level design 

6.6.1 With a split-level design, a robust estimate of the repeatability standard deviation s^ for a level may be 
obtained by applying Algorithm A to the cell differences for the level to derive a robust value s*, from equation (61), 
and then calculating s^ using 

5, =5*^ (75) 

6.6.2 A robust estimate of the standard deviation of cell averages s for a level may be obtained by applying 
Algorithm A again to the cell averages for the level to derive a robust value 5* from equation (61), and then obtaining 
iy as'. 

s,=s* (76) 

The formulae given in 4.5.6 may then be used to calculate an estimate of the reproducibility standard deviation for 
the level. 

6.7 Example 5: Robust analysis for a particular level of a split-level design 

6.7.1 The data of Example 1 in 4.8 contained a number of stragglers and an outlier (see table 8). Also, the figure 3 
showed a consistent negative bias in the results from Laboratory 5. If the data analyst cannot discover the causes 
of these anomalies then he/she is put in the difficult position of having to decide which data, if any, to exclude from 
the calculation of the repeatability and reproducibility standard deviations. The data for Level 14 (see table 4) are 
used here to illustrate the results that are obtained by robust analysis. 

6.7.2 To obtain a robust estimate of the repeatability standard deviation, apply Algorithm A to the cell differences 
(from table 5). This gives the results shown in table 27, in which the celt differences have been sorted into 
increasing order. From the four iterations shown in the table, it appears that the robust values are x* = 8,29 and 
s*= 0,36, and that only x'g differsfrom j:' by more than <;t). 

Applying the method described in 6.2.6 with wl = and u\j-1 gives 

x' = 8,219 and s' = 0,257 % protein 

so equations (62) and (63) in 6.2.6 may be written: 

;c* = 8,219 + 1,5 x ^78 
and 

{s*f =7x (0,257)^ /[s /1,1 342 -1.5^(0 + 9- 0)/8] 

giving 

5* = 0.354% protein 
and, using equation (75) in 6.6.1, 

s^ = 0,354/^/2 = 0,250 % protein 
The robust average of the cell differences is 

j:* = 8.219-h1,5 X 0,354/8 = 8,285% protein 
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With these values of ^* and s*, 

(p = 1,5 X 0,354 = 0,531 
so 

x*-(p = 7,754 and x * + <? = 8,81 6 % protein 

It was assumed for the calculation of j:*and s*tha\ only xg was outside these limits. It may be confirmed that this is 
indeed the case, so that a valid solution has been obtained. 

6.7.3 Applying Algorithm A to the cell averages (from table 6) gives the results shown in table 28, in which the cell 
averages have been entered in increasing order. The situation here is similar to that found in table 26, where x^ 
and x'q are more than cp from x\ and j:* is converging on the average of X2 to x^ , namely 85,486. Applying the 
method of 6.2.6 again, but with ml = mu = 1 . the average and standard deviation of x'2 to x'^ are: 

x' = 85,486 and 5' = 0,209 

Hence equation (63) in 6.2.6 may be used to derive 5*from: 

{s*f=6 X (0,209)^ /[8/1,134^ -1,5^(9 + 9-4)77] 

giving 

j* = 0,390 7o protein 
Now equation (62) in 6.2.6 may be used to give 

.?* = 85,486% protein 
To check that the solution is valid, calculate 

<p = X5 X 0,390 = 0,585 
and 

x* -(p = 84,901 and x* + (p = 86,071 % protein 
It will be seen that, as assumed, only x\ and jcg fall outside these limits. 
To obtain the reproducibility standard deviation, use equation (76) in 6.6.2 to give: 

Sy = 0,390 % protein 

and then equation (13) in 4.5.6 to give: 
sr =0,410% protein 

Hence, in this example, the robust method gives estimates s^ and s^ that are somewhat smaller than the values 
obtained using all the data as reported (given in table 7). 
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Table 27 — Example 5: Applying Algorithm A to the cell differences (% protein) 



Iteration 





1 


2 


3 


4 


9 


— 


0,53 


0,56 


0.55 


0,54 


x'-ip 
x' + <p 


— 


7,85 
8,91 


7,74 
8,86 


7,74 
8,84 


7,75 
8,83 


^i 


7,81 


7,85 


7,81 


7,81 


7,81 


4 


7,93 


7,93 


7,93 


7.93 


7,93 


^3 


8,13 


8,13 


8,13 


8.13 


8,13 


xl 


8,14 


8.14 


8,14 


8.14 


8,14 


^5 


8,38 


8.38 


8,38 


8,38 


8,38 


■^6 


8,40 


8.40 


8,40 


8,40 


8.40 


x? 


8,44 


8,44 


8,44 


8,44 


8.44 


4 


8,52 


8,52 


8,52 


8,52 


8,52 


X9 


9,31 


8,91 


8,86 


8,84 


8,83 


Average 


8,340 


8,300 


8,290 


8,288 


8,287 


Standard deviation 


0.436 


0,326 


0,322 


0,317 


0,315 


Newx* 
New J* 


8,380 1) 
0.356 1) 


8,300 
0,370 


8,290 
0,365 


8,288 
0,359 


8,287 
0,357 


1 ) Obtained using equations (56) and (57) in 6.2.3. 


Table 28 — Example 5: Applying Algorithm A to the cell averages (% protein) 


Iteration 





1 


2 


3 


4 


f 


— 


0,446 


0,492 


0.519 


0,537 


x'-<p 
x'+ (p 


— 


85,104 
85,996 


85,009 
85,993 


84.971 
86.009 


84,950 
86,024 


x] 


84,525 


85,104 


85,009 


84,971 


84.950 


^2 


85,140 


85,140 


85,140 


85.140 


85.140 


X3 


85,345 


85,345 


85,345 


85.345 


85.345 


xl 


85,385 


85,385 


85,385 


85,385 


85,385 


x's 


85,550 


85,550 


85,550 


85,550 


85,550 


x'e 


85,575 


85,575 


85,575 


85,575 


85,575 


^7 


85,660 


85,660 


85,660 


85,660 


85.660 


-«8 


85,750 


85.750 


85,750 


85,750 


85,750 


^^9 


86,170 


85,996 


85,993 


86,009 


86,024 


Average 


85,456 


85,501 


85,490 


85,487 


85,487 


Standard deviation 


0,453 


0.289 


0,305 


0,316 


0,324 


Newjc* 
Newi* 


85,550 1) 
0,297 1) 


85,501 
0,328 


85,490 
0,346 


85,487 
0,358 


85,487 
0,367 


1 ) Obtained using equations (56) and (57) in 6.2.3. 
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6.8 Formulae: Robust analysis for a particular level of an experiment on a heterogeneous 
material 

6.8.1 With the design for a heterogeneous material, in the usual case when two samples are prepared for each of 
p' laboratories at each level, and two test results are obtained on each sample, robust estimates of the repeatability 
and reproducibility standard deviations may be obtained by three applications of Algorithms A and S as follows. 

a) Apply Algorithm S to the between-test-resuit ranges to derive a robust value w*from equation (67) in 6.3.4, and 
set 

SS,=2p'{w*f (77) 

b) Apply Algorithm S to the between-sample ranges to derive another robust value w*from equation (67), and set 

SSH=p'{w*f (78) 

c) Apply Algorithm A to the cell averages to derive a robust value s*irom equation (61) in 6.2.4, and set 

Sy=s* (79) 

These calculations may be set out conveniently in tabular form, with the first column of ranges or averages entered 
in increasing order, as shown in the examples that follow. 

6.8.2 The formulae given in 5.5 may then be used to calculate estimates of the repeatability and reproducibility 
standard deviations, and of the standard deviation Sf^ that measures variation between the samples. 

6.9 Example 6: Robust analysis for a particular level of an experiment on a heterogeneous 
material 

6.9.1 The data for Level 6 of Example 2 in 5.8 do not contain any outliers or stragglers, so they are used here to 
illustrate the results that are obtained by robust analysis in such a case. 

6.9.2 Applying Algorithm 8 to the between-test-result ranges (from table 14) gives the results shown in table 29. 
Here the degrees of freedom i> = 1 so tj = 1 ,645 and ^ = 1 ,097, and the number of data items p = 2p' = 22. From the 
four iterations shown in the table, it appears that the robust value is 1^*= 4,5 and that wjg to w^ exceed ij/. With Z' 
and «u defined as in 6.3.6, in this case: 

«u = 4 

Y/[wif jp = 137,92/22 = 6,269 1 
so equation (68) in 6.3.6 becomes 

(w *f = 1,0972 X 6,269 1 + 4(t097 x 1,645 w *f /22 

giving 

M'* = 4,30% 

It may then be confirmed that with this value of w*, y/= 7,1, and the four values w]^ to W22 exceed y/, so that this 
value of w* is a valid solution. 
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Using equation (77) in 6.8.1 then gives: 
SS, = 22 X 4.30^ = 406.78 %^ 

6.9.3 Applying Algorithm 8 a second time, to the between-sample ranges (from table 15) gives the results shown 
in table 30. From the four iterations shown in the table, it appears that the robust value is w* = 4,0, and that w^q ^^^ 
w^i exceed y/. With I' and ml defined as in 6.3.6, in this case: 

MU = 2 

2'(w*) /p' = 66,665/11 = 6,060 5 
so equation (68) in 6.3.6 becomes 

{w*f=X097^ X 6,060 5 + 2(t097 x t645w*)^/11 
giving 

w* = 4,23% 

Unfortunately, this corresponds to v^= 1,645 x 4,23 = 6,96, so it is not valid solution because w\q and w\^ do not 
exceed this value. This suggests that the solution may require u^J = ^ or mu = 0. 

Trying u\j - 1 gives 

S'(w*) />' = 112,227 5/1 1 = 10,202 5 
so equation (68) now becomes 

(vw*)2= 1,097^ X 10,202 5 + (1,097 x 1,645 w*)^/11 
giving 

w* = 4.18% 

Now v/= 1,645 x 4,18 = 6,88, and this can be seen to be a valid solution because only w\^^ exceeds this value. 
Using equation (78) in 6.8.1) then gives: 

55« = 1 1 X 4,1 8^ = 1 92,20 %^ 

6.9.4 Applying Algorithm A to the cell averages (from table 16) gives the results shown in table 31 . The calculation 
converges after two iterations to give s*= 5,70 (with no x\ more than <pfrom x*). 

Using equation (79) in 6.8.1 then gives: 

Sy = 5,70 % 
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6.9.5 Combining the results obtained in 6.9.2, 6.9.3 and 6.9.4, equations (29) to (33) in 5.5.5 now give: 
s^ =406,78/44%^ 

4 = 5.70^ + (406.78 - 1 92,20)/44 %2 

sfi =192,20/22-406,78/88 %^ 
so 

s, = 3.04 % 
sn = 6.1 1 % 
Sff = 2,03 % 

Hence in this example, the robust method gives estimates v *r and s„ that are marginally larger than the values 
obtained using all the data as reported (given in 5.8.3 and table 17), 
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Table 29 — Example 6: Applying Algorithm S to between-test-result ranges 

(v= 1:^=1,097; 7]= 1,645) 



Iteration 





1 


2 


3 


4 


V 


— 


3,9 


5,1 


5,9 


6,4 


w] 


0,1 


0,1 


0,1 


0,1 


0,1 


W2 


0,6 


0,6 


0,6 


0,6 


0,6 


W3 


1,1 


1,1 


1.1 


1,1 


1,1 


wl 


1,1 


1,1 


1,1 


1,1 


1,1 


W5 


1,2 


1,2 


1,2 


1,2 


1.2 


Wq 


1.3 


"1,3 


1,3 


1,3 


1,3 


Wj 


1,4 


1,4 


1,4 


1.4 


1,4 


Wq 


1,6 


1,6 


1,6 


1,6 


1.6 


Wg 


1,8 


1,8 


1,8 


1,8 


1,8 


'^io 


2,1 


2,1 


2,1 


2.1 


2.1 


^11 


2,2 


2,2 


2,2 


2.2 


2,2 


w\2 


2,5 


2,5 


2,5 


2,5 


2.5 


^^1*3 


2,6 


2,6 


2,6 


2,6 


2,6 


w\^ 


3,9 


3,9 


3,9 


3,9 


3,9 


^1*5 


4,0 


3,9 


4,0 


4,0 


4,0 


We 


4,4 


3,9 


4,4 


4,4 


4,4 


w\y 


4,6 


3,9 


43 


4,6 


4,6 


»^18 


5,5 


3,9 


5,1 


5,5 


5.5 


wig 


7,4 


3.9 


5,1 


5,9 


6.4 


W20 


7,6 


3,9 


5,1 


5,9 


6.4 


W21 


8.1 


3,9 


5,1 


5,9 


6.4 


W22 


8,1 


3,9 


5,1 


5,9 


6.4 


Newvv 
New vw* 


4,17 
2,35 1) 


2,80 
3,07 


3,29 
3,61 


3,55 
3,89 


3,70 
4.06 


1) Obtained using equation (64) in 6.3.3. 
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Table 30 — Example 6: Applying algorithm S to between-sample ranges (%) 

(v=1;^ = 1,097; 7] = 1,645) 



Iteration 





1 


2 


3 


4 


W 


— 


4,19 


5.43 


6,10 


6,45 


wj 


1,00 


1,00 


1,00 


1,00 


1,00 


W2 


1,70 


1,70 


1,70 


1,70 


1,70 


Wg 


2,05 


2,05 


2,05 


2,05 


2,05 


W^ 


2,25 


2,25 


2,25 


2,25 


2,25 


Wg 


2,55 


2,55 


2,55 


2,55 


2.55 


w'q 


2,55 


2,55 


2,55 


2,55 


2,55 


w'y 


3,15 


3,15 


3,15 


3,15 


3,15 


WQ 


3,35 


3,35 


3,35 


3,35 


3,35 


H'9 


4,40 


4,19 


4,40 


4.40 


4,40 


wio ^ 


6,75 


4,19 


5,43 


6,10 


6,45 


M-'l-l 


6,95 


4,19 


5,43 


6,10 


6,45 


New w 
New w* 


3,82 

2,551) 


3,01 
3,30 


3,38 
3,71 


3.58 
3.92 


3,69 
4,05 


1 ) Obtained using equation (64) in 6.3.3. 



Table 31 — Example 6: Applying algorithm A to cell averages (%) 



Iteration 





1 


2 


3 


4 


<P 


— 


10,005 


8,550 






x'-,p 

x'^-i- (p 




8,245 
28,255 


10,450 
27,550 






•«i 


13,425 


13,425 


13,425 






X2 


13,425 


13,425 


13,425 






^3 


13.750 


13,750 


13,750 






x\ 


14,475 


14,475 


14,475 






x's 


17,075 


17.075 


17,075 






H 


18,250 


18,250 


18,250 






X? 


21 .000 


21.000 


21,000 






x's 


21.225 


21.225 


21 ,225 






^9 


23,675 


23,675 


23,675 






^1*0 


26,275 


26.275 


26,275 






^ii 


26,425 


26,425 


26.425 






Average 


19,00 


19.00 


19,00 






Standard deviation 


5,03 


5,03 


5,03 






New^* 
New J* 


18,25 1) 
6,67 1) 


19,00 
5,70 


19,00 
5,70 






1) Obtained using equations (56) and (57) in^.2.3. 
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Annex A 

(normative) 

Symbols and abbreviations used in ISO 5725 



ii Intercept in the relationship 

s = a + bm 

A Factor used to calculate the uncer- 

tainty of an estimate 

b Slope in the relationship 

s = a + bm 

B Component in a test result represent- 

ing the deviation of a laboratory from 
the general average (laboratory 
component of bias) 

Bq Component of B representing all 

factors that do not change in inter- 
mediate precision conditions 

^(1)' ^(2)' ^^^- Component of 6 representing factors 
that vary in intermediate precision 
conditions 

c Intercept in the relationship 

\g s = c + d\Qm 

C, C, C" Test statistics 

Qrit- ^'crit' *'"crit Critical values for statistical tests 

CD;, Critical difference for probability P 

CRp Critical range for probability P 

d Slope in the relationship 

\gs=^c + d\gm 

e Component in a test result rep- 

resenting the random error occurring 
in every test result 

/ Critical range factor 

^p (^1 • "2) ;j-quantile of the F-distribution with y^ 

and i»2 degrees of freedom 

Gmbbs' test statistic 

Mandel's between-laboratory consis- 
tency test statistic 



G 

h 



k Mandel's within-laboratory consistency test 
statistic 

LCL Lower control limit (either action limit or warning 
limit) 

m General mean of the test property; level 

M Number of factors considered in intermediate 
precision conditions 

n Number of test results obtained in one 
laboratory at one level (i.e. per cell) 

N Number of iterations 

p Number of laboratories participating in the 
interlaboratory experiment 

P Probability 

q Number of levels of the test property in the 
interlaboratory experiment 

r Repeatability limit 

R Reproducibility limit 

RM Reference material 

5 Estimate of a standard deviation 

s Predicted standard deviation 

t Number of test objects or groups 

T Total or sum of some expression 

UCL Upper control limit (either action limit or warning 
limit) 

w Range of a set of test results 

W Weighting factor used in calculating a weighted 
regression 

X Datum used for Grubbs' test 

y Test result 

y Arithmetic mean of test results 
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y Grand mean of test results 

a Significance level 

P Type il error probability 

y Ratio of the reproducibility standard devi- 

ation to the repeatability standard deviation 

5 Bias Qf the measurement method 

8 Estimate of 5 

A Laboratory bias 

A Estimate of A 

k Detectable difference between two labora- 

tory biases or the biases of two 
measurement methods 

// True value or accepted reference value of a 

test property 

V Number of degrees of freedom 

p Detectable ratio between the repeatability 

standard deviations of method B and 
method A 

a True value of a standard deviation 

T Component in a test result representing the 

variation due to time since last calibration 

(^ Detectable ratio between the square roots 

of the between-laboratory mean squares of 
method B and method A 

Zp(^) p-quantile of the ;f2.(jjstribution with t; 
degrees of freedom 

Symbols used as subscripts 

C Calibration-different 

E Equipment-different 

(' Identifier for a particular laboratory 

/( ) Identifier for intermediate measures of 

precision; in brackets, identification of the 
type of intermediate situation 
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i Identifier for a particular level 

(ISO 5725-2). 

Identifier for a group of tests or for a 
factor (ISO 5725-3) 

k Identifier for a particular test result in a 

laboratory! at level > 



L 

m 

M 

O 

P 

r 

R 

T 

W 



Between-laboratory (interlaboratory) 

Identifier for detectable bias 

Between-test-sample 

Operator-different 

Probability 

Repeatability 

Reproducibility 

Time-different 

Within-laboratory (intralaboratory) 



1, 2, 3... For test results, numbering in the order 

of obtaining them 

(1), (2), (3)... For test results, numbering in the order 
of increasing magnitude 



Additional symbols and abbreviations used in 
ISO 5725-5 



D 



H 



K 



SS 
"L 



Within-cell difference in a split-level 
experiment 

Number of samples tested in a 
laboratory at one level 

Component in a measurement result 
representing the random error of the 
sample 

Function of the numbers of measure- 
ment results in cells 

Number of laboratories participating in 
the interlaboratory experiment 

Sum of squares 

Number of data values below a lower 
limit in robust analysis 
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Ku Number of data values above an upper limit in 
robust analysis 

z Residual 

Ratio of standard deviations 

<p Limit used in robust analysis (Algorithm A) 

Tj Limit factor used in robust analysis 

(Algorithm S) 

I// Limit used in robust analysis (Algorithm S) 

^ Adjustment factor used in robust analysis 

(Algorithm 8) 



Additional symbols used as subscripts in 
ISO 5725-5 

a, b Identifiers for samples in a split-level 
experiment 

t Identifier for a sample in a laboratory i at level ;' 

H Between-sample 



Additional symbol used as a superscript in 
ISO 5725-5 

* A robust estimate 
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Annex B 

(informative) 

Derivation of the factors used in Algorithms A and S 



B.I Introduction 

The use of robust methods of analysing the data from precision experiments was proposed by the Analytical 
Methods Committee of the Royal Society of Chemistry, UK (see reference [6]). "Algorithm A" in this part of ISO 5725 
is derived from their paper, and the factor 1,134 used to calculate j*in Algorithm A is also taken from their paper (It 
is the value of 1 / V^ for the case c = 1 ,5 in the notation of the paper). 

"Algorithm S" is similar to the procedure given in reference [6] for the special case where each laboratory reports 
« = 2 measurements per level. It provides a convenient method of applying robust analysis to precision experiments 
with more than two factors (such as the design for a heterogeneous material in clause 5 of this part of ISO 5725, 
and the staggered-nested designs of ISO 5725-3). The derivation of the factors used in algorithm S is set out below. 



B.2 Symbols used in this annex 

o true standard deviation 

5 standard deviation that gives an estimate of a 

V degrees of freedom of i 

(a v+ 2 

^ adjustment factor for Algorithm S 

77 limit factor for Algorithm S 

X% chi-squared variate with v degrees of freedom 



[(pa if 5 > TjCT 



B.3 Derivation of tJie limit factor 77 and the adjustment factor ^ 

The adjustment factor ^ is defined as the value needed to adjust s* so that (s*)^ gives an unbiased estimate of d^, 
i.e. so that: 

E[{^xsf} = a^ (B.1) 

This requirement may be written: 

£{v(^*/(Tf} = v/^2 (B.2) 

where the quantity in { } is closely related to v(.y / a)^ ,.a chi-squared variate, Xv ■ 
The probability density function of the chi-squared variate Xv 's: 
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/(;c) = e--^/2>/2-i)2-v/2/r(v/2) {B.3) 

so 

VT) ~ 

£{v{5*/ct)^}= jxf(x)6x+ jvT]^f(x)cix (B.4) 

v,,2 

because the limit s < rjcris equivalent to v{s/a)^ < vr^. 
The second term on the right-hand side of (B.4) is 

V7j2 X pf;f;2 > Vn2j = V7]2 X P(5 >TJct) (B.5) 

For Algorithm S, the limit factor rj is chosen so that r\a is the upper 10 % point of the distribution of s, i.e. so that: 

P{s > 77ct) = 0,1 (B.6) 

Biometrika Tables for the chi-squared distribution give the values of ri shown in table 23 of this part of ISO 5725. 
Equations (B.5) and B.6) imply that the second term on the right-hand side of equation (B.4) is 0,1 vtf. Note that tj 
depends on the degrees of freedom of s. 

The first term on the right-hand side of equation (B.4) may be written: 
\xe-'^x''^-^2-''^ /r{v/2)6x 



With ft} = V + 2, a well-known property of the gamma function is that: 

^{(o/2) = ^{v/2 + ^) = {v/2)x^{v/2) 

so this first term may be rewritten as: 



,^2 
V7J 



I ve-"^x'"^-''2-'^'^ /r(ft,/2)d;c 



= vxz (B.7) 

Thus for a given number of degrees of freedom v, rj may be calculated as described above, and then z may be 
evaluated using tables of the chi-squared distribution given in Biometrika Tables again, so that both terms on the 
right-hand side of (B.4) may be evaluated. 

Substituting equations (B.2), (B.5), (B.6) and (B.7) in (B.4), gives: 

v/^2 = V XZ + 0,1 VTj2 

or 



^ = ^/^z + Q^r}^ (B.8) 

This may be used to obtain the values of the adjustment factor | given in table 23 of this part of ISO 5725. 
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Annex C 

(informative) 

Derivation of equations used for robust analysis 

Equations (62) and (63), used to calculate robust values of the average and standard deviation by the method 
described in 6.2.6, may be derived from equations (60) and (61) in 6.2.4 (Algorithm A) as follows. 

With the notation as set out in 6.2.4 and 6.2.6: 

x' = ^x;/p (C.1) 

-t' = X'-»^,(/'-«L-«u) (C.2) 

and 

s' ^ ^j2l, {xi - x') /(/?-«(_ -My -1) (C.3) 

where X represents summation over the (p- u\_- uyj) data items Xj for which Ix, - x*| < rp . 

Hence equation (C.1) may be written: 

pxx*^Y^x* 

= ^' Xi+u\_x{x*--X5 s*) + u\j x(;r* + 1,5 5*) 
so 

{p-u\_-u\j)xx*=[p-u\_-uij)xx' + [ui_-u\j)xs* 

giving 

x*- x' + \5{u\j -ui)s */{p-ui -u\j) (C.4) 

which is equation (62) in 6.2.6. 

To derive equation (63) from equation (61), note that the summation term in equation (61) may be expanded as 
follows: 

£(x;-x*) =I,'(xi-x*)2+(uL + uu)x(t5s*)2 (C.5) 

Substituting forx* in the summation term here using equation (C.4) gives, after some algebra: 

XK~-^*) ^Zi\xi-x'f +{X5s*f x{pu\_ + puu-4u^_u^J)/{p~u\_-u^J) (C.6) 

Using the definition of s' in equation (C.3), this may be written: 

p 

X(^' ~^ *) = (i^ - «L - «U -1) X {^'f + (15 J *f X {pu\_ + /7«u - 4ml«u)/(/' - Ml - «u) (C.7) 

Substituting equation (C.7) in equation (61), then gives equation (63). 
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Annex D 

(informative) 
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